Jun 02 16:03:18 devstack cinder-volume[75752]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 16:03:18 devstack cinder-volume[75752]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 16:03:18 devstack cinder-volume[75752]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 16:03:19 devstack cinder-volume[75752]: INFO dbcounter [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Registered counter for database cinder Jun 02 16:03:19 devstack cinder-volume[75752]: DEBUG oslo_db.sqlalchemy.engines [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75752) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 16:03:19 devstack cinder-volume[75752]: DEBUG dbcounter [-] [75752] Writer thread running {{(pid=75752) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 16:03:19 devstack cinder-volume[75752]: INFO cinder.rpc [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 02 16:03:19 devstack cinder-volume[75752]: INFO cinder.rpc [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 02 16:03:19 devstack cinder-volume[75752]: DEBUG oslo_db.sqlalchemy.engines [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75752) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 16:03:19 devstack cinder-volume[75752]: INFO cinder.volume.manager [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Determined volume DB was empty at startup. Jun 02 16:03:19 devstack cinder-volume[75752]: DEBUG cinder.volume.manager [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75752) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 02 16:03:19 devstack cinder-volume[75752]: INFO cinder.volume.manager [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 02 16:03:19 devstack cinder-volume[75752]: WARNING stevedore.named [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 02 16:03:19 devstack cinder-volume[75752]: WARNING castellan.key_manager [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 16:03:19 devstack cinder-volume[75752]: WARNING cinder.keymgr.conf_key_mgr [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 16:03:19 devstack cinder-volume[75752]: DEBUG cinder.volume.drivers.lvm [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75752) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 02 16:03:19 devstack cinder-volume[75752]: DEBUG oslo_concurrency.processutils [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_concurrency.processutils [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.373s {{(pid=75752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_db.sqlalchemy.engines [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75752) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 16:03:20 devstack cinder-volume[75752]: INFO cinder.rpc [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 02 16:03:20 devstack cinder-volume[75752]: INFO cinder.rpc [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 02 16:03:20 devstack cinder-volume[75752]: WARNING stevedore.named [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 02 16:03:20 devstack cinder-volume[75752]: WARNING castellan.key_manager [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 16:03:20 devstack cinder-volume[75752]: INFO cinder.volume.manager [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_db.sqlalchemy.engines [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75752) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 16:03:20 devstack cinder-volume[75752]: INFO oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Starting 1 workers Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Started child 75953 {{(pid=75752) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Full set of CONF: {{(pid=75752) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] ******************************************************************************** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Configuration options gathered from: {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] ================================================================================ {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] allow_availability_zone_fallback = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75953]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] allow_compression_on_image_upload = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] allowed_direct_url_schemes = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] api_rate_limit = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] auth_strategy = keystone {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] az_cache_duration = 3600 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_availability_zone = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_host = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_stats_polling_interval = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backup_api_class = cinder.backup.api.API {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backup_name_template = backup-%s {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backup_use_same_host = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backup_use_temp_snapshot = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] chap_password = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] chap_username = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cinder_internal_tenant_project_id = 710be5c804864ddf9244874f2d7ed316 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cinder_internal_tenant_user_id = b761818ded1c4d2ea6479e1412919e15 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cloned_volume_same_az = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cluster = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] compression_format = gzip {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] compute_api_class = cinder.compute.nova.API {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] config_dir = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] config_source = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack sudo[75957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] control_exchange = openstack {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] debug = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] default_availability_zone = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] default_group_type = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack sudo[75957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] default_volume_type = lvmdriver-1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] disk_geometry = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] driver_client_cert = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] driver_client_cert_key = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] driver_data_namespace = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] driver_ssl_cert_path = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] driver_ssl_cert_verify = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] driver_use_ssl = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] enable_force_upload = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] enable_new_services = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] enable_unsupported_driver = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] enforce_multipath_for_image_xfer = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] filter_function = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance_api_insecure = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance_api_servers = ['http://192.168.122.136/image'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance_api_ssl_compression = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance_ca_certificates_file = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance_catalog_info = image:glance:publicURL {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance_certfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance_keyfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance_num_retries = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance_request_timeout = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] goodness_function = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] graceful_shutdown_timeout = 5 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] group_api_class = cinder.group.api.API {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] host = devstack {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] image_compress_on_upload = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] image_conversion_address_space_limit = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] image_conversion_cpu_limit = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] image_conversion_disable = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] image_upload_use_cinder_backend = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] image_upload_use_internal_tenant = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] image_volume_cache_enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] image_volume_cache_max_count = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] image_volume_cache_max_size_gb = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] init_host_max_objects_retrieval = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] instance_format = [instance: %(uuid)s] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] iscsi_target_flags = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] iscsi_write_cache = on {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] iser_helper = tgtadm {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] iser_ip_address = 192.168.122.136 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] iser_port = 3260 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] log_color = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75953]: INFO cinder.volume.manager [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 02 16:03:20 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] log_config_append = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] log_dir = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] log_file = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] log_options = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] log_rotate_interval = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] log_rotate_interval_type = days {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] log_rotation_type = none {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] max_age = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] max_logfile_count = 30 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] max_logfile_size_mb = 200 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] max_over_subscription_ratio = 20.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] message_reap_interval = 86400 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] message_ttl = 2592000 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] migration_create_volume_timeout_secs = 300 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] monkey_patch = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] monkey_patch_modules = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] my_ip = 192.168.122.136 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] no_snapshot_gb_quota = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] num_iser_scan_tries = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] num_shell_tries = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] num_volume_device_scan_tries = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] nvmeof_conn_info_version = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] nvmet_ns_id = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] nvmet_port_id = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] osapi_max_limit = 1000 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] osapi_volume_ext_list = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] osapi_volume_listen_port = 8776 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] osapi_volume_use_ssl = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] osapi_volume_workers = 2 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] per_volume_size_limit = -1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] periodic_fuzzy_delay = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] periodic_interval = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] public_endpoint = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] publish_errors = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] quota_backup_gigabytes = 1000 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] quota_backups = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] quota_gigabytes = 1000 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] quota_groups = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] quota_snapshots = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] quota_volumes = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] rate_limit_burst = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] rate_limit_except_level = CRITICAL {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] rate_limit_interval = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] reinit_driver_count = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] replication_device = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] report_discard_supported = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] report_interval = 120 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] reservation_clean_interval = 86400 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] reservation_expire = 86400 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] reserved_image_namespaces = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] reserved_percentage = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] rpc_response_timeout = 120 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] run_external_periodic_tasks = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] scst_target_driver = iscsi {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] scst_target_iqn_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] service_down_time = 720 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] shell_completion = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] snapshot_name_template = snapshot-%s {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] snapshot_same_host = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] split_loggers = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] state_path = /opt/stack/data/cinder {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] storage_availability_zone = nova {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] storage_protocol = iSCSI {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] syslog_log_facility = LOG_USER {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] target_helper = lioadm {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] target_ip_address = 192.168.122.136 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] target_port = 3260 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] target_protocol = iscsi {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] target_secondary_ip_addresses = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] trace_flags = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] transport_url = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] until_refresh = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] use_chap_auth = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] use_default_quota_class = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] use_journal = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] use_json = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] use_multipath_for_image_xfer = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] use_stderr = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] use_syslog = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] verify_glance_signatures = enabled {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] volume_api_class = cinder.volume.api.API {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] volume_backend_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] volume_clear = zero {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] volume_clear_ionice = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] volume_clear_size = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] volume_copy_bps_limit = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] volume_dd_blocksize = 1M {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] volume_name_template = volume-%s {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] volume_service_inithost_offload = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] volume_usage_audit_period = month {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] zoning_mode = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_concurrency.disable_process_locking = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.admin_password = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.admin_token = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.admin_user = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.auth_port = 35357 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.auth_protocol = https {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.auth_section = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.auth_type = password {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.auth_uri = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.auth_version = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.cache = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.certfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.identity_uri = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.include_service_catalog = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.insecure = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.interface = public {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.keyfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.memcache_password = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.memcache_username = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.region_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:20 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.service_type = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.136/identity {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.backend = dogpile.cache.null {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.backend_argument = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.backend_expiration_time = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.config_prefix = cache.oslo {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.debug_cache_backend = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.enable_retry_client = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.enable_socket_keepalive = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.enforce_fips_mode = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.expiration_time = 600 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.hashclient_retry_attempts = 2 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.memcache_dead_retry = 300 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.memcache_pool_maxsize = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.memcache_sasl_enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.password = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.proxies = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.redis_db = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.redis_server = localhost:6379 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.retry_attempts = 2 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.retry_delay = 0.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.socket_keepalive_count = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.socket_keepalive_idle = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.socket_keepalive_interval = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.socket_timeout = 1.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.tls_allowed_ciphers = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.tls_cafile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.tls_certfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.tls_enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.tls_keyfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cache.username = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] coordination.backend_url = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.asyncio_connection = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.asyncio_slave_connection = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.backend = sqlalchemy {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.connection = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.connection_debug = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.connection_parameters = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.connection_recycle_time = 3600 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.connection_trace = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.db_inc_retry_interval = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.db_max_retries = 20 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.db_max_retry_interval = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.db_retry_interval = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.max_overflow = 50 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.max_pool_size = 5 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.max_retries = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.mysql_wsrep_sync_wait = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.pool_timeout = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.retry_interval = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.slave_connection = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.sqlite_synchronous = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.synchronous_reader = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] database.use_db_reconnect = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] profiler.connection_string = messaging:// {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] profiler.enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] profiler.es_doc_type = notification {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] profiler.es_scroll_size = 10000 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] profiler.es_scroll_time = 2m {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] profiler.filter_error_trace = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] profiler.hmac_keys = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] profiler.sentinel_service_name = mymaster {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] profiler.socket_timeout = 0.1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] profiler.trace_requests = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] profiler.trace_sqlalchemy = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] profiler_jaeger.process_tags = {} {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] profiler_jaeger.service_name_prefix = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] profiler_otlp.service_name_prefix = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_policy.enforce_new_defaults = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: WARNING oslo_config.cfg [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_policy.enforce_scope = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_policy.policy_default_rule = default {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_policy.policy_file = policy.yaml {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] privsep_osbrick.group = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] privsep_osbrick.helper_command = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] privsep_osbrick.user = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cinder_sys_admin.group = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cinder_sys_admin.helper_command = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] cinder_sys_admin.user = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] service_user.auth_section = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] service_user.auth_type = password {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] service_user.cafile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] service_user.certfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] service_user.collect_timing = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] service_user.insecure = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] service_user.keyfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] service_user.send_service_user_token = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] service_user.split_loggers = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] service_user.timeout = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance.auth_section = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance.auth_type = password {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance.certfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance.collect_timing = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance.insecure = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance.keyfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance.region_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance.split_loggers = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] glance.timeout = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.backend_availability_zone = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.chap_password = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.chap_username = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.disk_geometry = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.driver_client_cert = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.driver_client_cert_key = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.driver_data_namespace = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.driver_use_ssl = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.extra_capabilities = {} {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.filter_function = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.goodness_function = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.iscsi_target_flags = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.iscsi_write_cache = on {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.iser_helper = tgtadm {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.iser_ip_address = 192.168.122.136 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.iser_port = 3260 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.lvm_share_target = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.lvm_type = auto {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.num_shell_tries = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.replication_device = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.report_discard_supported = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.reserved_percentage = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.target_helper = tgtadm {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.target_ip_address = 192.168.122.136 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.target_port = 3260 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.target_protocol = iscsi {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.trace_flags = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.unique_fqdn_network = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.use_chap_auth = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack sudo[75957]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.volume_backend_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.volume_clear = zero {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.volume_clear_ionice = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.volume_clear_size = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_reports.file_event_handler = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_reports.log_dir = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.backend_host = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.chap_password = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.chap_username = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.disk_geometry = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.driver_client_cert = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.extra_capabilities = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.filter_function = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.goodness_function = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.iser_helper = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.iser_ip_address = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.iser_port = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.lvm_share_target = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.lvm_type = auto {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.num_shell_tries = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.replication_device = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.report_discard_supported = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.reserved_percentage = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.scst_target_driver = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.storage_protocol = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.target_helper = lioadm {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.target_ip_address = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.target_port = 3260 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.trace_flags = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.use_chap_auth = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.volume_clear = zero {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.volume_clear_size = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] lvmdriver-1.volumes_dir = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.ssl = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_notifications.driver = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_notifications.retry = -1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] key_manager.fixed_key = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican.barbican_api_version = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack sudo[76180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican.barbican_endpoint = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican.barbican_endpoint_type = public {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican.barbican_region_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican.cafile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican.certfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican.collect_timing = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican.insecure = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack sudo[76180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican.keyfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican.number_of_retries = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican.retry_delay = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican.send_service_user_token = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican.split_loggers = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican.timeout = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican.verify_ssl = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican.verify_ssl_path = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican_service_user.auth_section = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican_service_user.auth_type = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican_service_user.cafile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican_service_user.certfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican_service_user.collect_timing = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican_service_user.insecure = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican_service_user.keyfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican_service_user.split_loggers = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] barbican_service_user.timeout = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] vault.approle_role_id = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] vault.approle_secret_id = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] vault.kv_mountpoint = secret {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] vault.kv_path = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] vault.kv_version = 2 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] vault.namespace = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] vault.root_token_id = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] vault.ssl_ca_crt_file = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] vault.timeout = 60.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] vault.use_ssl = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:03:21 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] ******************************************************************************** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 02 16:03:21 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.779s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:21 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:21 devstack sudo[76180]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:21 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.626s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:21 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:03:21 devstack cinder-volume[75953]: INFO cinder.brick.local_dev.lvm [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 02 16:03:21 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:21 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:21 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:21 devstack sudo[76369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 16:03:21 devstack sudo[76369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:22 devstack sudo[76369]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:22 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:22 devstack cinder-volume[75953]: DEBUG cinder.brick.local_dev.lvm [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75953) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 02 16:03:22 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:22 devstack sudo[76522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 16:03:22 devstack sudo[76522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:23 devstack sudo[76522]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:23 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.060s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:23 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:23 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:23 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:23 devstack sudo[76699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 16:03:23 devstack sudo[76699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:24 devstack sudo[76699]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:24 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.717s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:24 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:24 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:24 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:24 devstack sudo[76735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 02 16:03:24 devstack sudo[76735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:24 devstack sudo[76735]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:24 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.592s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:24 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:24 devstack sudo[76745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 16:03:24 devstack sudo[76745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:25 devstack sudo[76745]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:25 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.608s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:25 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:25 devstack sudo[76752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 16:03:25 devstack sudo[76752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:26 devstack sudo[76752]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:26 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:26 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:26 devstack sudo[76756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 16:03:26 devstack sudo[76756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:26 devstack sudo[76756]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:26 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.602s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:26 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:26 devstack sudo[76761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 16:03:26 devstack sudo[76761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:27 devstack sudo[76761]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:27 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.678s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:27 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:27 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:27 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:27 devstack sudo[76766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 16:03:27 devstack sudo[76766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:28 devstack sudo[76766]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:28 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.654s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:28 devstack cinder-volume[75953]: INFO cinder.volume.drivers.lvm [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 02 16:03:28 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:28 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:28 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:28 devstack sudo[76774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 16:03:28 devstack sudo[76774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:29 devstack sudo[76774]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.892s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:29 devstack cinder-volume[75953]: DEBUG cinder.volume.drivers.lvm [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Updating volume stats {{(pid=75953) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 16:03:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:29 devstack sudo[76875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 16:03:29 devstack sudo[76875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:29 devstack sudo[76875]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.579s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:29 devstack sudo[76901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 16:03:29 devstack sudo[76901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:30 devstack sudo[76901]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:30 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:30 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:30 devstack sudo[76983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 16:03:30 devstack sudo[76983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:30 devstack cinder-volume[75752]: DEBUG dbcounter [-] [75752] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75752) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:03:30 devstack sudo[76983]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:30 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.589s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:30 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:30 devstack sudo[77046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 16:03:30 devstack sudo[77046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:31 devstack sudo[77046]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:31 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.573s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:31 devstack cinder-volume[75953]: INFO cinder.volume.driver [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Driver hasn't implemented _init_vendor_properties() Jun 02 16:03:31 devstack cinder-volume[75953]: DEBUG cinder.volume.driver [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75953) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 02 16:03:31 devstack cinder-volume[75953]: DEBUG oslo_db.sqlalchemy.engines [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75953) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 16:03:31 devstack cinder-volume[75953]: DEBUG dbcounter [-] [75953] Writer thread running {{(pid=75953) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 16:03:31 devstack cinder-volume[75953]: DEBUG cinder.db.sqlalchemy.api [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Building query based on filter {{(pid=75953) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 02 16:03:31 devstack cinder-volume[75953]: DEBUG cinder.image.image_utils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75953) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 02 16:03:31 devstack cinder-volume[75953]: INFO cinder.keymgr.migration [None req-0a3844ba-038f-4592-8307-1db0b82dacc6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 02 16:03:31 devstack cinder-volume[75953]: DEBUG cinder.volume.drivers.lvm [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Updating volume stats {{(pid=75953) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 16:03:31 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:31 devstack sudo[77053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 16:03:31 devstack sudo[77053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:32 devstack sudo[77053]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:32 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.592s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:32 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:32 devstack sudo[77057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 16:03:32 devstack sudo[77057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:32 devstack sudo[77057]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:32 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.587s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:32 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:32 devstack sudo[77061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 16:03:32 devstack sudo[77061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:33 devstack sudo[77061]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:33 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.627s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:33 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:33 devstack sudo[77064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 16:03:33 devstack sudo[77064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:33 devstack sudo[77064]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:33 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.591s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:33 devstack cinder-volume[75953]: DEBUG cinder.manager [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Notifying Schedulers of capabilities ... {{(pid=75953) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:03:33 devstack cinder-volume[75953]: INFO cinder.volume.manager [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Driver initialization completed successfully. Jun 02 16:03:33 devstack cinder-volume[75953]: INFO cinder.manager [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Initiating service 2 cleanup Jun 02 16:03:33 devstack cinder-volume[75953]: INFO cinder.manager [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Service 2 cleanup completed. Jun 02 16:03:33 devstack cinder-volume[75953]: DEBUG cinder.service [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Creating RPC server for service cinder-volume {{(pid=75953) start /opt/stack/cinder/cinder/service.py:231}} Jun 02 16:03:33 devstack cinder-volume[75953]: DEBUG cinder.service [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75953) start /opt/stack/cinder/cinder/service.py:237}} Jun 02 16:03:34 devstack cinder-volume[75953]: INFO cinder.volume.manager [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 02 16:03:34 devstack cinder-volume[75953]: DEBUG cinder.volume.drivers.lvm [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Updating volume stats {{(pid=75953) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 16:03:34 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:34 devstack sudo[77068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 16:03:34 devstack sudo[77068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:34 devstack sudo[77068]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:34 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:34 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:34 devstack sudo[77075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 16:03:34 devstack sudo[77075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:35 devstack sudo[77075]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:35 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:35 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:35 devstack sudo[77080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 16:03:35 devstack sudo[77080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:35 devstack sudo[77080]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:35 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.625s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:35 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:03:35 devstack sudo[77083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 16:03:35 devstack sudo[77083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:03:36 devstack sudo[77083]: pam_unix(sudo:session): session closed for user root Jun 02 16:03:36 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:03:36 devstack cinder-volume[75953]: INFO cinder.volume.manager [None req-d67fc4ae-97de-405c-8949-521d72bf53eb None None] Driver post RPC initialization completed successfully. Jun 02 16:03:43 devstack cinder-volume[75953]: DEBUG dbcounter [-] [75953] Writing DB stats cinder:SELECT=2 {{(pid=75953) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:03:46 devstack cinder-volume[75953]: DEBUG dbcounter [-] [75953] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75953) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:04:28 devstack cinder-volume[75953]: DEBUG oslo_service.periodic_task [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75953) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:04:28 devstack cinder-volume[75953]: DEBUG cinder.volume.drivers.lvm [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Updating volume stats {{(pid=75953) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 16:04:28 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:04:28 devstack sudo[78775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 16:04:28 devstack sudo[78775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:04:29 devstack sudo[78775]: pam_unix(sudo:session): session closed for user root Jun 02 16:04:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.582s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:04:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:04:29 devstack sudo[78778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 16:04:29 devstack sudo[78778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:04:29 devstack sudo[78778]: pam_unix(sudo:session): session closed for user root Jun 02 16:04:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:04:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:04:29 devstack sudo[78879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 16:04:29 devstack sudo[78879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:04:30 devstack sudo[78879]: pam_unix(sudo:session): session closed for user root Jun 02 16:04:30 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.586s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:04:30 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:04:30 devstack sudo[78882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 16:04:30 devstack sudo[78882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:04:30 devstack sudo[78882]: pam_unix(sudo:session): session closed for user root Jun 02 16:04:30 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:04:30 devstack cinder-volume[75953]: DEBUG cinder.manager [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Notifying Schedulers of capabilities ... {{(pid=75953) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:05:28 devstack cinder-volume[75953]: DEBUG oslo_service.periodic_task [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75953) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:05:28 devstack cinder-volume[75953]: DEBUG cinder.volume.drivers.lvm [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Updating volume stats {{(pid=75953) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 16:05:28 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:05:28 devstack sudo[82180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 16:05:28 devstack sudo[82180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:05:29 devstack sudo[82180]: pam_unix(sudo:session): session closed for user root Jun 02 16:05:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:05:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:05:29 devstack sudo[82186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 16:05:29 devstack sudo[82186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:05:29 devstack sudo[82186]: pam_unix(sudo:session): session closed for user root Jun 02 16:05:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:05:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:05:29 devstack sudo[82189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 16:05:29 devstack sudo[82189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:05:30 devstack sudo[82189]: pam_unix(sudo:session): session closed for user root Jun 02 16:05:30 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.570s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:05:30 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:05:30 devstack sudo[82192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 16:05:30 devstack sudo[82192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:05:30 devstack sudo[82192]: pam_unix(sudo:session): session closed for user root Jun 02 16:05:30 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.576s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:05:30 devstack cinder-volume[75953]: DEBUG cinder.manager [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Notifying Schedulers of capabilities ... {{(pid=75953) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:05:46 devstack cinder-volume[75953]: DEBUG dbcounter [-] [75953] Writing DB stats cinder:SELECT=1 {{(pid=75953) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:05:46 devstack cinder-volume[75953]: DEBUG dbcounter [-] [75953] Writing DB stats cinder:UPDATE=1 {{(pid=75953) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:06:28 devstack cinder-volume[75953]: DEBUG oslo_service.periodic_task [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75953) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:06:28 devstack cinder-volume[75953]: DEBUG cinder.volume.drivers.lvm [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Updating volume stats {{(pid=75953) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 16:06:28 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:06:28 devstack sudo[83891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 16:06:28 devstack sudo[83891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:06:29 devstack sudo[83891]: pam_unix(sudo:session): session closed for user root Jun 02 16:06:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:06:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:06:29 devstack sudo[83927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 16:06:29 devstack sudo[83927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:06:29 devstack sudo[83927]: pam_unix(sudo:session): session closed for user root Jun 02 16:06:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.587s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:06:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:06:29 devstack sudo[83945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 16:06:29 devstack sudo[83945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:06:30 devstack sudo[83945]: pam_unix(sudo:session): session closed for user root Jun 02 16:06:30 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.598s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:06:30 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:06:30 devstack sudo[83968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 16:06:30 devstack sudo[83968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:06:30 devstack sudo[83968]: pam_unix(sudo:session): session closed for user root Jun 02 16:06:30 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.571s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:06:30 devstack cinder-volume[75953]: DEBUG cinder.manager [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Notifying Schedulers of capabilities ... {{(pid=75953) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:07:28 devstack cinder-volume[75953]: DEBUG oslo_service.periodic_task [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75953) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:07:28 devstack cinder-volume[75953]: DEBUG cinder.volume.drivers.lvm [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Updating volume stats {{(pid=75953) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 16:07:28 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:07:28 devstack sudo[85031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 16:07:28 devstack sudo[85031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:07:29 devstack sudo[85031]: pam_unix(sudo:session): session closed for user root Jun 02 16:07:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.562s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:07:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:07:29 devstack sudo[85034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 16:07:29 devstack sudo[85034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:07:29 devstack sudo[85034]: pam_unix(sudo:session): session closed for user root Jun 02 16:07:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.554s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:07:29 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:07:29 devstack sudo[85039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 16:07:29 devstack sudo[85039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:07:30 devstack sudo[85039]: pam_unix(sudo:session): session closed for user root Jun 02 16:07:30 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.547s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:07:30 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:07:30 devstack sudo[85048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 16:07:30 devstack sudo[85048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:07:30 devstack sudo[85048]: pam_unix(sudo:session): session closed for user root Jun 02 16:07:30 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.560s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:07:30 devstack cinder-volume[75953]: DEBUG cinder.manager [None req-f4e6399e-ceb3-4a1c-a5c9-308db3e6ac8a None None] Notifying Schedulers of capabilities ... {{(pid=75953) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:07:46 devstack cinder-volume[75953]: DEBUG dbcounter [-] [75953] Writing DB stats cinder:SELECT=1 {{(pid=75953) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:07:46 devstack cinder-volume[75953]: DEBUG dbcounter [-] [75953] Writing DB stats cinder:UPDATE=1 {{(pid=75953) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:07:56 devstack cinder-volume[75752]: INFO oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Caught SIGTERM, stopping children Jun 02 16:07:56 devstack cinder-volume[75752]: DEBUG oslo_concurrency.lockutils [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Acquiring lock "singleton_lock" {{(pid=75752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 16:07:56 devstack cinder-volume[75752]: DEBUG oslo_concurrency.lockutils [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Acquired lock "singleton_lock" {{(pid=75752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 16:07:56 devstack cinder-volume[75752]: DEBUG oslo_concurrency.lockutils [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Releasing lock "singleton_lock" {{(pid=75752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 16:07:56 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Stop services. {{(pid=75752) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 02 16:07:56 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Killing children. {{(pid=75752) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 02 16:07:56 devstack cinder-volume[75752]: INFO oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Waiting on 1 children to exit Jun 02 16:07:59 devstack cinder-volume[75953]: DEBUG oslo_concurrency.lockutils [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Acquiring lock "singleton_lock" {{(pid=75953) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 16:07:59 devstack cinder-volume[75953]: DEBUG oslo_concurrency.lockutils [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Acquired lock "singleton_lock" {{(pid=75953) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 16:07:59 devstack cinder-volume[75953]: DEBUG oslo_concurrency.lockutils [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Releasing lock "singleton_lock" {{(pid=75953) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 16:07:59 devstack cinder-volume[75953]: WARNING amqp [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 02 16:07:59 devstack cinder-volume[75953]: WARNING amqp [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 02 16:07:59 devstack cinder-volume[75752]: INFO oslo_service.backend._eventlet.service [None req-a7289aa3-698e-40d2-98ba-d64e6a01f4f2 None None] Child 75953 exited with status 0 Jun 02 16:08:01 devstack cinder-volume[85668]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85668) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 16:08:01 devstack cinder-volume[85668]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85668) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 16:08:01 devstack cinder-volume[85668]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85668) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 16:08:02 devstack cinder-volume[85668]: INFO dbcounter [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Registered counter for database cinder Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_db.sqlalchemy.engines [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85668) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG dbcounter [-] [85668] Writer thread running {{(pid=85668) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 16:08:02 devstack cinder-volume[85668]: INFO cinder.rpc [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 02 16:08:02 devstack cinder-volume[85668]: INFO cinder.rpc [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_db.sqlalchemy.engines [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85668) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 16:08:02 devstack cinder-volume[85668]: INFO cinder.volume.manager [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Determined volume DB was empty at startup. Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG cinder.volume.manager [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85668) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 02 16:08:02 devstack cinder-volume[85668]: INFO cinder.volume.manager [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 02 16:08:02 devstack cinder-volume[85668]: WARNING stevedore.named [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 02 16:08:02 devstack cinder-volume[85668]: WARNING castellan.key_manager [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 16:08:02 devstack cinder-volume[85668]: WARNING cinder.keymgr.conf_key_mgr [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 16:08:02 devstack cinder-volume[85668]: INFO cinder.volume.manager [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_db.sqlalchemy.engines [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85668) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 16:08:02 devstack cinder-volume[85668]: INFO oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Starting 1 workers Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Started child 85839 {{(pid=85668) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Full set of CONF: {{(pid=85668) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] ******************************************************************************** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Configuration options gathered from: {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] ================================================================================ {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] allow_availability_zone_fallback = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] allow_compression_on_image_upload = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] allowed_direct_url_schemes = [] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85839]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] api_rate_limit = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] auth_strategy = keystone {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_availability_zone = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_host = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_name = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_stats_polling_interval = 60 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backup_api_class = cinder.backup.api.API {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backup_name_template = backup-%s {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backup_use_same_host = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backup_use_temp_snapshot = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] chap_password = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] chap_username = {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cinder_internal_tenant_project_id = 710be5c804864ddf9244874f2d7ed316 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cinder_internal_tenant_user_id = b761818ded1c4d2ea6479e1412919e15 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cluster = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] compression_format = gzip {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] compute_api_class = cinder.compute.nova.API {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] config_dir = [] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] config_source = [] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] control_exchange = openstack {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] debug = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] default_availability_zone = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] default_group_type = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] default_volume_type = QuobyteHD {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] disk_geometry = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] driver_client_cert = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] driver_client_cert_key = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] driver_data_namespace = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] driver_ssl_cert_path = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] driver_ssl_cert_verify = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] driver_use_ssl = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] enable_new_services = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] enable_unsupported_driver = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] enabled_backends = ['QuobyteHD'] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] enforce_multipath_for_image_xfer = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] filter_function = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance_api_insecure = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance_api_servers = ['http://192.168.122.136/image'] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance_api_ssl_compression = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance_ca_certificates_file = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance_catalog_info = image:glance:publicURL {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance_certfile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance_keyfile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance_num_retries = 3 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance_request_timeout = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] goodness_function = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] graceful_shutdown_timeout = 5 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] group_api_class = cinder.group.api.API {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] host = devstack {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] image_compress_on_upload = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] image_conversion_address_space_limit = 1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] image_conversion_cpu_limit = 60 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] image_conversion_disable = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] image_upload_use_cinder_backend = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85839]: INFO cinder.volume.manager [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Starting volume driver QuobyteDriver (1.1.14) Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] image_upload_use_internal_tenant = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] image_volume_cache_enabled = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] image_volume_cache_max_count = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] image_volume_cache_max_size_gb = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] init_host_max_objects_retrieval = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] instance_format = [instance: %(uuid)s] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] iscsi_target_flags = {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] iscsi_write_cache = on {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] iser_helper = tgtadm {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] iser_ip_address = 192.168.122.136 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] iser_port = 3260 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85839]: DEBUG cinder.volume.drivers.remotefs [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85839) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] log_color = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] log_config_append = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] log_dir = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] log_file = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] log_options = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] log_rotate_interval = 1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] log_rotate_interval_type = days {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] log_rotation_type = none {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] max_age = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] max_logfile_count = 30 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] max_logfile_size_mb = 200 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] max_over_subscription_ratio = 20.0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] message_reap_interval = 86400 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] message_ttl = 2592000 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] migration_create_volume_timeout_secs = 300 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] monkey_patch = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] monkey_patch_modules = [] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] my_ip = 192.168.122.136 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] no_snapshot_gb_quota = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] num_iser_scan_tries = 3 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] num_shell_tries = 3 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] num_volume_device_scan_tries = 3 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] nvmeof_conn_info_version = 1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] nvmet_ns_id = 10 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] nvmet_port_id = 1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] osapi_max_limit = 1000 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] osapi_volume_ext_list = [] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] osapi_volume_listen_port = 8776 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] osapi_volume_use_ssl = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] osapi_volume_workers = 2 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] per_volume_size_limit = -1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] periodic_fuzzy_delay = 60 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] periodic_interval = 60 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] public_endpoint = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] publish_errors = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] quota_backup_gigabytes = 1000 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] quota_backups = 10 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] quota_gigabytes = 1000 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] quota_groups = 10 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] quota_snapshots = 10 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] quota_volumes = 10 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] rate_limit_burst = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] rate_limit_except_level = CRITICAL {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] rate_limit_interval = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] reinit_driver_count = 3 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] replication_device = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] report_discard_supported = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] report_interval = 120 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] reservation_clean_interval = 86400 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] reservation_expire = 86400 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] reserved_image_namespaces = [] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] reserved_percentage = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] rpc_response_timeout = 120 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] run_external_periodic_tasks = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] scst_target_driver = iscsi {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] scst_target_iqn_name = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] service_down_time = 720 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] shell_completion = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] snapshot_name_template = snapshot-%s {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] split_loggers = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] state_path = /opt/stack/data/cinder {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] storage_availability_zone = nova {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] storage_protocol = iSCSI {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] syslog_log_facility = LOG_USER {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] target_helper = lioadm {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] target_ip_address = 192.168.122.136 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] target_port = 3260 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] target_protocol = iscsi {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] target_secondary_ip_addresses = [] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] trace_flags = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] transport_url = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] until_refresh = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] use_chap_auth = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] use_default_quota_class = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] use_journal = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] use_json = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] use_multipath_for_image_xfer = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] use_stderr = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] use_syslog = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] verify_glance_signatures = enabled {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] volume_api_class = cinder.volume.api.API {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] volume_backend_name = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] volume_clear = zero {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] volume_clear_ionice = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] volume_clear_size = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] volume_copy_bps_limit = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] volume_dd_blocksize = 1M {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] volume_name_template = volume-%s {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] volume_service_inithost_offload = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] volume_usage_audit_period = month {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] zoning_mode = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_concurrency.disable_process_locking = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.admin_password = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.admin_token = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.admin_user = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.auth_admin_prefix = {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.auth_port = 35357 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.auth_protocol = https {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.auth_section = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.auth_type = password {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.auth_uri = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.auth_version = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.cache = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.certfile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.identity_uri = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.include_service_catalog = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.insecure = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.interface = public {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.keyfile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.memcache_password = {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85839]: DEBUG cinder.volume.drivers.quobyte [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85839) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85839]: WARNING cinder.volume.drivers.quobyte [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 02 16:08:02 devstack cinder-volume[85839]: WARNING cinder.volume.drivers.quobyte [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85839]: DEBUG oslo_concurrency.processutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Running cmd (subprocess): mount.quobyte {{(pid=85839) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.memcache_username = {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.region_name = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.service_type = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.136/identity {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.backend = dogpile.cache.null {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.backend_argument = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.backend_expiration_time = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.config_prefix = cache.oslo {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.debug_cache_backend = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.enable_retry_client = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.enable_socket_keepalive = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.enabled = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.enforce_fips_mode = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.expiration_time = 600 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.hashclient_retry_attempts = 2 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.memcache_dead_retry = 300 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.memcache_pool_maxsize = 10 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.memcache_sasl_enabled = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.password = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.proxies = [] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.redis_db = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.redis_server = localhost:6379 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.retry_attempts = 2 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.retry_delay = 0.0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.socket_keepalive_count = 1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.socket_keepalive_idle = 1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.socket_keepalive_interval = 1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.socket_timeout = 1.0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.tls_allowed_ciphers = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.tls_cafile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.tls_certfile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.tls_enabled = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.tls_keyfile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cache.username = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] coordination.backend_url = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.asyncio_connection = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.asyncio_slave_connection = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.backend = sqlalchemy {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.connection = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.connection_debug = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.connection_parameters = {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.connection_recycle_time = 3600 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.connection_trace = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.db_inc_retry_interval = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.db_max_retries = 20 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.db_max_retry_interval = 10 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.db_retry_interval = 1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.max_overflow = 50 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.max_pool_size = 5 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.max_retries = 10 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.mysql_wsrep_sync_wait = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.pool_timeout = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.retry_interval = 10 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.slave_connection = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.sqlite_synchronous = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.synchronous_reader = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] database.use_db_reconnect = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] profiler.connection_string = messaging:// {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] profiler.enabled = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] profiler.es_doc_type = notification {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] profiler.es_scroll_size = 10000 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] profiler.es_scroll_time = 2m {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] profiler.filter_error_trace = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] profiler.hmac_keys = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] profiler.sentinel_service_name = mymaster {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] profiler.socket_timeout = 0.1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] profiler.trace_requests = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] profiler.trace_sqlalchemy = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] profiler_jaeger.process_tags = {} {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] profiler_jaeger.service_name_prefix = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] profiler_otlp.service_name_prefix = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_policy.enforce_new_defaults = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: WARNING oslo_config.cfg [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_policy.enforce_scope = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_policy.policy_default_rule = default {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_policy.policy_file = policy.yaml {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] privsep_osbrick.group = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] privsep_osbrick.helper_command = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] privsep_osbrick.user = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cinder_sys_admin.group = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cinder_sys_admin.helper_command = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] cinder_sys_admin.user = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] service_user.auth_section = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] service_user.auth_type = password {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] service_user.cafile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] service_user.certfile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] service_user.collect_timing = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] service_user.insecure = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] service_user.keyfile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] service_user.send_service_user_token = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] service_user.split_loggers = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] service_user.timeout = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance.auth_section = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance.auth_type = password {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance.certfile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance.collect_timing = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance.insecure = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance.keyfile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance.region_name = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance.split_loggers = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] glance.timeout = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.backend_availability_zone = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.chap_password = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.chap_username = {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.disk_geometry = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.driver_client_cert = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.driver_client_cert_key = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.driver_data_namespace = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.driver_use_ssl = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.extra_capabilities = {} {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.filter_function = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.goodness_function = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.iscsi_target_flags = {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.iscsi_write_cache = on {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.iser_helper = tgtadm {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.iser_ip_address = 192.168.122.136 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.iser_port = 3260 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.nas_host = {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.nas_login = admin {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.nas_mount_options = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.nas_password = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.nas_private_key = {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.nas_share_path = {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.num_shell_tries = 3 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack quobyte-client[85917]: Reading configuration file: /etc/quobyte/client.cfg Jun 02 16:08:02 devstack quobyte-client[85917]: Invalid parameters found, error: missing mount point. Jun 02 16:08:02 devstack quobyte-client[85917]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 02 16:08:02 devstack quobyte-client[85917]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.quobyte_volume_url = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.replication_device = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.report_discard_supported = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.reserved_percentage = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85839]: DEBUG oslo_concurrency.processutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] CMD "mount.quobyte" returned: 1 in 0.148s {{(pid=85839) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.target_helper = tgtadm {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.target_ip_address = 192.168.122.136 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.target_port = 3260 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.target_protocol = iscsi {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85839]: DEBUG oslo_concurrency.lockutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85839) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:08:02 devstack cinder-volume[85839]: DEBUG oslo_concurrency.lockutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85839) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:08:02 devstack cinder-volume[85839]: DEBUG cinder.volume.drivers.quobyte [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=85839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.trace_flags = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.unique_fqdn_network = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85839]: INFO cinder.volume.drivers.quobyte [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 ... Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.use_chap_auth = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85839]: DEBUG oslo_concurrency.processutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d -c /etc/quobyte/client-cinder.cfg {{(pid=85839) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.volume_backend_name = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.volume_clear = zero {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.volume_clear_ionice = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.volume_clear_size = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_reports.file_event_handler = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_reports.log_dir = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.backend_availability_zone = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.backend_host = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.chap_password = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.chap_username = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.chiscsi_conf = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.disk_geometry = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.driver_client_cert = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.driver_data_namespace = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.driver_use_ssl = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.extra_capabilities = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.filter_function = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.goodness_function = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:02 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.iser_helper = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.iser_ip_address = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.iser_port = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.iser_target_prefix = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.nas_host = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.nas_login = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.nas_mount_options = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.nas_password = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.nas_private_key = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.nas_share_path = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.nas_ssh_port = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.num_shell_tries = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.nvmet_port_id = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack sudo[85920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d -c /etc/quobyte/client-cinder.cfg Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.replication_device = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.report_discard_supported = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.reserved_percentage = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack sudo[85920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.scst_target_driver = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.storage_protocol = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.target_helper = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.target_ip_address = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.target_port = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.target_prefix = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.target_protocol = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.trace_flags = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.use_chap_auth = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.volume_clear = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.volume_clear_size = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] QuobyteHD.volumes_dir = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.ssl = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_notifications.driver = [] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_notifications.retry = -1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] key_manager.fixed_key = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican.barbican_api_version = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican.barbican_endpoint = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican.barbican_endpoint_type = public {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican.barbican_region_name = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican.cafile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican.certfile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican.collect_timing = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican.insecure = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican.keyfile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican.number_of_retries = 60 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican.retry_delay = 1 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican.send_service_user_token = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican.split_loggers = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican.timeout = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican.verify_ssl = True {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican.verify_ssl_path = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican_service_user.auth_section = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican_service_user.auth_type = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican_service_user.cafile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican_service_user.certfile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican_service_user.collect_timing = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican_service_user.insecure = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican_service_user.keyfile = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican_service_user.split_loggers = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] barbican_service_user.timeout = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] vault.approle_role_id = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] vault.approle_secret_id = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] vault.kv_mountpoint = secret {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] vault.kv_path = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] vault.kv_version = 2 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] vault.namespace = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] vault.root_token_id = **** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] vault.ssl_ca_crt_file = None {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] vault.timeout = 60.0 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] vault.use_ssl = False {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:03 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] ******************************************************************************** {{(pid=85668) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 02 16:08:03 devstack sudo[85920]: pam_unix(sudo:session): session closed for user root Jun 02 16:08:03 devstack cinder-volume[85839]: DEBUG oslo_concurrency.processutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.797s {{(pid=85839) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:08:03 devstack cinder-volume[85839]: INFO cinder.volume.drivers.quobyte [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 succeeded Jun 02 16:08:03 devstack cinder-volume[85839]: DEBUG cinder.volume.drivers.quobyte [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=85839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:08:03 devstack cinder-volume[85839]: DEBUG oslo_concurrency.lockutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.811s {{(pid=85839) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:08:03 devstack cinder-volume[85839]: DEBUG oslo_concurrency.processutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=85839) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:08:03 devstack sudo[85995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:08:03 devstack sudo[85995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:08:04 devstack sudo[85995]: pam_unix(sudo:session): session closed for user root Jun 02 16:08:04 devstack cinder-volume[85839]: DEBUG oslo_concurrency.processutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.564s {{(pid=85839) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:08:04 devstack cinder-volume[85839]: INFO cinder.volume.driver [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Driver hasn't implemented _init_vendor_properties() Jun 02 16:08:04 devstack cinder-volume[85839]: DEBUG cinder.volume.driver [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757984161377, 'free_capacity_gb': 1775.757984161377, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85839) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 02 16:08:04 devstack cinder-volume[85839]: DEBUG oslo_db.sqlalchemy.engines [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85839) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 16:08:04 devstack cinder-volume[85839]: DEBUG dbcounter [-] [85839] Writer thread running {{(pid=85839) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 16:08:04 devstack cinder-volume[85839]: DEBUG cinder.db.sqlalchemy.api [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Building query based on filter {{(pid=85839) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 02 16:08:04 devstack cinder-volume[85839]: DEBUG cinder.image.image_utils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85839) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 02 16:08:04 devstack cinder-volume[85839]: INFO cinder.keymgr.migration [None req-c6e75767-7e8b-4cd0-b41b-25b7e6892fa1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 02 16:08:04 devstack cinder-volume[85839]: DEBUG oslo_concurrency.lockutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85839) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:08:04 devstack cinder-volume[85839]: DEBUG oslo_concurrency.lockutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85839) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:08:04 devstack cinder-volume[85839]: DEBUG cinder.volume.drivers.quobyte [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=85839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:08:04 devstack cinder-volume[85839]: DEBUG cinder.volume.drivers.quobyte [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=85839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:08:04 devstack cinder-volume[85839]: DEBUG oslo_concurrency.lockutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85839) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:08:04 devstack cinder-volume[85839]: DEBUG oslo_concurrency.processutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=85839) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:08:04 devstack sudo[85999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:08:04 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:08:05 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root Jun 02 16:08:05 devstack cinder-volume[85839]: DEBUG oslo_concurrency.processutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.691s {{(pid=85839) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:08:05 devstack cinder-volume[85839]: DEBUG cinder.manager [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Notifying Schedulers of capabilities ... {{(pid=85839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:08:05 devstack cinder-volume[85839]: INFO cinder.volume.manager [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Driver initialization completed successfully. Jun 02 16:08:05 devstack cinder-volume[85839]: INFO cinder.manager [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Initiating service 3 cleanup Jun 02 16:08:05 devstack cinder-volume[85839]: INFO cinder.manager [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Service 3 cleanup completed. Jun 02 16:08:05 devstack cinder-volume[85839]: DEBUG cinder.service [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Creating RPC server for service cinder-volume {{(pid=85839) start /opt/stack/cinder/cinder/service.py:231}} Jun 02 16:08:05 devstack cinder-volume[85839]: DEBUG cinder.service [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85839) start /opt/stack/cinder/cinder/service.py:237}} Jun 02 16:08:05 devstack cinder-volume[85839]: INFO cinder.volume.manager [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 02 16:08:05 devstack cinder-volume[85839]: DEBUG oslo_concurrency.lockutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85839) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:08:05 devstack cinder-volume[85839]: DEBUG oslo_concurrency.lockutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85839) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:08:05 devstack cinder-volume[85839]: DEBUG cinder.volume.drivers.quobyte [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=85839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:08:05 devstack cinder-volume[85839]: DEBUG cinder.volume.drivers.quobyte [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=85839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:08:05 devstack cinder-volume[85839]: DEBUG oslo_concurrency.lockutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85839) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:08:05 devstack cinder-volume[85839]: DEBUG oslo_concurrency.processutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=85839) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:08:05 devstack sudo[86030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:08:05 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:08:06 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root Jun 02 16:08:06 devstack cinder-volume[85839]: DEBUG oslo_concurrency.processutils [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.790s {{(pid=85839) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:08:06 devstack cinder-volume[85839]: INFO cinder.volume.manager [None req-35d6b18c-4e54-440c-b964-0e1819dca81c None None] Driver post RPC initialization completed successfully. Jun 02 16:08:08 devstack cinder-volume[85839]: DEBUG oslo_concurrency.lockutils [None req-34a391f3-b9f8-450d-92e6-bdee0e1d4fdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85839) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:08:08 devstack cinder-volume[85839]: DEBUG oslo_concurrency.lockutils [None req-34a391f3-b9f8-450d-92e6-bdee0e1d4fdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85839) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:08:08 devstack cinder-volume[85839]: DEBUG cinder.volume.drivers.quobyte [None req-34a391f3-b9f8-450d-92e6-bdee0e1d4fdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=85839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:08:08 devstack cinder-volume[85839]: DEBUG cinder.volume.drivers.quobyte [None req-34a391f3-b9f8-450d-92e6-bdee0e1d4fdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=85839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:08:08 devstack cinder-volume[85839]: DEBUG oslo_concurrency.lockutils [None req-34a391f3-b9f8-450d-92e6-bdee0e1d4fdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85839) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:08:08 devstack cinder-volume[85839]: DEBUG oslo_concurrency.processutils [None req-34a391f3-b9f8-450d-92e6-bdee0e1d4fdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=85839) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:08:08 devstack sudo[86122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:08:08 devstack sudo[86122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:08:09 devstack sudo[86122]: pam_unix(sudo:session): session closed for user root Jun 02 16:08:09 devstack cinder-volume[85839]: DEBUG oslo_concurrency.processutils [None req-34a391f3-b9f8-450d-92e6-bdee0e1d4fdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.608s {{(pid=85839) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:08:09 devstack cinder-volume[85839]: DEBUG cinder.manager [None req-34a391f3-b9f8-450d-92e6-bdee0e1d4fdc None None] Notifying Schedulers of capabilities ... {{(pid=85839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:08:10 devstack cinder-volume[85668]: INFO oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Caught SIGTERM, stopping children Jun 02 16:08:10 devstack cinder-volume[85668]: DEBUG oslo_concurrency.lockutils [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Acquiring lock "singleton_lock" {{(pid=85668) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 16:08:10 devstack cinder-volume[85668]: DEBUG oslo_concurrency.lockutils [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Acquired lock "singleton_lock" {{(pid=85668) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 16:08:10 devstack cinder-volume[85668]: DEBUG oslo_concurrency.lockutils [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Releasing lock "singleton_lock" {{(pid=85668) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 16:08:10 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Stop services. {{(pid=85668) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 02 16:08:10 devstack cinder-volume[85668]: DEBUG oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Killing children. {{(pid=85668) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 02 16:08:10 devstack cinder-volume[85668]: INFO oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Waiting on 1 children to exit Jun 02 16:08:13 devstack cinder-volume[85839]: DEBUG oslo_concurrency.lockutils [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Acquiring lock "singleton_lock" {{(pid=85839) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 16:08:13 devstack cinder-volume[85839]: DEBUG oslo_concurrency.lockutils [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Acquired lock "singleton_lock" {{(pid=85839) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 16:08:13 devstack cinder-volume[85839]: DEBUG oslo_concurrency.lockutils [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Releasing lock "singleton_lock" {{(pid=85839) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 16:08:13 devstack cinder-volume[85839]: WARNING amqp [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 02 16:08:13 devstack cinder-volume[85839]: WARNING amqp [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 02 16:08:13 devstack cinder-volume[85668]: INFO oslo_service.backend._eventlet.service [None req-675ce83c-98e2-471d-8435-efc93ec2a1a3 None None] Child 85839 exited with status 0 Jun 02 16:08:16 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86210) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 16:08:16 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86210) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 16:08:16 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86210) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 16:08:17 devstack cinder-volume[86210]: INFO dbcounter [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] Registered counter for database cinder Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_db.sqlalchemy.engines [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86210) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG dbcounter [-] [86210] Writer thread running {{(pid=86210) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 16:08:17 devstack cinder-volume[86210]: INFO cinder.rpc [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 02 16:08:17 devstack cinder-volume[86210]: INFO cinder.rpc [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_db.sqlalchemy.engines [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86210) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 16:08:17 devstack cinder-volume[86210]: INFO cinder.volume.manager [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] Determined volume DB was empty at startup. Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG cinder.volume.manager [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86210) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 02 16:08:17 devstack cinder-volume[86210]: WARNING stevedore.named [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 02 16:08:17 devstack cinder-volume[86210]: WARNING castellan.key_manager [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 16:08:17 devstack cinder-volume[86210]: WARNING cinder.keymgr.conf_key_mgr [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 16:08:17 devstack cinder-volume[86210]: INFO cinder.volume.manager [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_db.sqlalchemy.engines [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86210) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 16:08:17 devstack cinder-volume[86210]: INFO oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] Starting 1 workers Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] Started child 86488 {{(pid=86210) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] Full set of CONF: {{(pid=86210) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] ******************************************************************************** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] Configuration options gathered from: {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] ================================================================================ {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] allow_availability_zone_fallback = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86488]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] allow_compression_on_image_upload = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] allowed_direct_url_schemes = [] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] api_rate_limit = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] auth_strategy = keystone {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_availability_zone = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_host = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_name = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_stats_polling_interval = 60 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backup_api_class = cinder.backup.api.API {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backup_name_template = backup-%s {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backup_use_same_host = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backup_use_temp_snapshot = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] chap_password = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] chap_username = {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cinder_internal_tenant_project_id = 710be5c804864ddf9244874f2d7ed316 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cinder_internal_tenant_user_id = b761818ded1c4d2ea6479e1412919e15 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cluster = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] compression_format = gzip {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] compute_api_class = cinder.compute.nova.API {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] config_dir = [] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] config_source = [] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] control_exchange = openstack {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] debug = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] default_availability_zone = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] default_group_type = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] default_volume_type = QuobyteHD {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] disk_geometry = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] driver_client_cert = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] driver_client_cert_key = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] driver_data_namespace = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] driver_ssl_cert_path = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] driver_ssl_cert_verify = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] driver_use_ssl = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] enable_new_services = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] enable_unsupported_driver = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] enabled_backends = ['QuobyteHD'] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] enforce_multipath_for_image_xfer = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] filter_function = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance_api_insecure = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance_api_servers = ['http://192.168.122.136/image'] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance_api_ssl_compression = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance_ca_certificates_file = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance_catalog_info = image:glance:publicURL {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance_certfile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance_keyfile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance_num_retries = 3 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance_request_timeout = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] goodness_function = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] graceful_shutdown_timeout = 5 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] group_api_class = cinder.group.api.API {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] host = devstack {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] image_compress_on_upload = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] image_conversion_address_space_limit = 1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Starting volume driver QuobyteDriver (1.1.14) Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] image_conversion_cpu_limit = 60 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86488) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] image_conversion_disable = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] image_upload_use_cinder_backend = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] image_upload_use_internal_tenant = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] image_volume_cache_enabled = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] image_volume_cache_max_count = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] image_volume_cache_max_size_gb = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] init_host_max_objects_retrieval = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] instance_format = [instance: %(uuid)s] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] iscsi_target_flags = {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] iscsi_write_cache = on {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] iser_helper = tgtadm {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] iser_ip_address = 192.168.122.136 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] iser_port = 3260 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] log_color = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] log_config_append = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] log_dir = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] log_file = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] log_options = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] log_rotate_interval = 1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] log_rotate_interval_type = days {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] log_rotation_type = none {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] max_age = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] max_logfile_count = 30 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] max_logfile_size_mb = 200 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] max_over_subscription_ratio = 20.0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] message_reap_interval = 86400 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] message_ttl = 2592000 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] migration_create_volume_timeout_secs = 300 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] monkey_patch = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] monkey_patch_modules = [] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] my_ip = 192.168.122.136 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] no_snapshot_gb_quota = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] num_iser_scan_tries = 3 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] num_shell_tries = 3 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] num_volume_device_scan_tries = 3 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] nvmeof_conn_info_version = 1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] nvmet_ns_id = 10 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] nvmet_port_id = 1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] osapi_max_limit = 1000 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] osapi_volume_ext_list = [] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] osapi_volume_listen = 0.0.0.0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] osapi_volume_listen_port = 8776 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] osapi_volume_use_ssl = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] osapi_volume_workers = 2 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] per_volume_size_limit = -1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] periodic_fuzzy_delay = 60 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] periodic_interval = 60 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] project_id_regex = [0-9a-f\-]+ {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] public_endpoint = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] publish_errors = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] quota_backup_gigabytes = 1000 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] quota_backups = 10 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] quota_gigabytes = 1000 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] quota_groups = 10 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] quota_snapshots = 10 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] quota_volumes = 10 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] rate_limit_burst = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] rate_limit_except_level = CRITICAL {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] rate_limit_interval = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] reinit_driver_count = 3 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] replication_device = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] report_discard_supported = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] report_interval = 120 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] reservation_clean_interval = 86400 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] reservation_expire = 86400 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] reserved_image_namespaces = [] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] reserved_percentage = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] rpc_response_timeout = 120 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] run_external_periodic_tasks = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] scst_target_driver = iscsi {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] scst_target_iqn_name = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] service_down_time = 720 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] shell_completion = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] snapshot_name_template = snapshot-%s {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] split_loggers = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] state_path = /opt/stack/data/cinder {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] storage_availability_zone = nova {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] storage_protocol = iSCSI {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] syslog_log_facility = LOG_USER {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] target_helper = lioadm {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] target_ip_address = 192.168.122.136 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] target_port = 3260 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] target_protocol = iscsi {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] target_secondary_ip_addresses = [] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] trace_flags = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] transfer_api_class = cinder.transfer.api.API {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] transport_url = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] until_refresh = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] use_chap_auth = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] use_default_quota_class = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] use_journal = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] use_json = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] use_multipath_for_image_xfer = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] use_stderr = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] use_syslog = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] verify_glance_signatures = enabled {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] volume_api_class = cinder.volume.api.API {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] volume_backend_name = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] volume_clear = zero {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] volume_clear_ionice = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] volume_clear_size = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] volume_copy_bps_limit = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] volume_dd_blocksize = 1M {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] volume_name_template = volume-%s {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] volume_service_inithost_offload = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] volume_usage_audit_period = month {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] zoning_mode = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_concurrency.disable_process_locking = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.admin_password = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.admin_tenant_name = admin {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.admin_token = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.admin_user = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.auth_admin_prefix = {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.auth_port = 35357 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86488) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.auth_protocol = https {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.auth_section = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.auth_type = password {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.quobyte [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 02 16:08:17 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.quobyte [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.auth_uri = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.auth_version = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.cache = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Running cmd (subprocess): mount.quobyte {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.certfile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.delay_auth_decision = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.http_connect_timeout = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.identity_uri = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.include_service_catalog = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.insecure = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.interface = public {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.keyfile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.memcache_password = {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.memcache_username = {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.region_name = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.service_token_roles_required = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.service_type = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.token_cache_time = 300 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.136/identity {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.backend = dogpile.cache.null {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.backend_argument = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.backend_expiration_time = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.config_prefix = cache.oslo {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.debug_cache_backend = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.enable_retry_client = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.enable_socket_keepalive = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.enabled = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.enforce_fips_mode = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.expiration_time = 600 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.hashclient_retry_attempts = 2 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.memcache_dead_retry = 300 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.memcache_pool_maxsize = 10 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.memcache_sasl_enabled = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.password = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.proxies = [] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.redis_db = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.redis_sentinel_service_name = mymaster {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.redis_server = localhost:6379 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.retry_attempts = 2 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.retry_delay = 0.0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.socket_keepalive_count = 1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.socket_keepalive_idle = 1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.socket_keepalive_interval = 1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.socket_timeout = 1.0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.tls_allowed_ciphers = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.tls_cafile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.tls_certfile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.tls_enabled = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.tls_keyfile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cache.username = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] coordination.backend_url = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.asyncio_connection = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.asyncio_slave_connection = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.backend = sqlalchemy {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.connection = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.connection_debug = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.connection_parameters = {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.connection_recycle_time = 3600 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.connection_trace = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.db_inc_retry_interval = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.db_max_retries = 20 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.db_max_retry_interval = 10 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.db_retry_interval = 1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.max_overflow = 50 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.max_pool_size = 5 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.max_retries = 10 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.mysql_wsrep_sync_wait = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.pool_timeout = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.retry_interval = 10 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.slave_connection = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.sqlite_synchronous = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.synchronous_reader = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] database.use_db_reconnect = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] profiler.connection_string = messaging:// {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] profiler.enabled = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] profiler.es_doc_type = notification {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] profiler.es_scroll_size = 10000 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] profiler.es_scroll_time = 2m {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] profiler.filter_error_trace = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] profiler.hmac_keys = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] profiler.sentinel_service_name = mymaster {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] profiler.socket_timeout = 0.1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] profiler.trace_requests = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] profiler.trace_sqlalchemy = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] profiler_jaeger.process_tags = {} {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] profiler_jaeger.service_name_prefix = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] profiler_otlp.service_name_prefix = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_policy.enforce_new_defaults = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack quobyte-client[86494]: Reading configuration file: /etc/quobyte/client.cfg Jun 02 16:08:17 devstack quobyte-client[86494]: Invalid parameters found, error: missing mount point. Jun 02 16:08:17 devstack cinder-volume[86210]: WARNING oslo_config.cfg [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_policy.enforce_scope = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_policy.policy_default_rule = default {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_policy.policy_file = policy.yaml {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack quobyte-client[86494]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_policy.remote_timeout = 60.0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] privsep_osbrick.group = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack quobyte-client[86494]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] privsep_osbrick.helper_command = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] privsep_osbrick.user = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cinder_sys_admin.group = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cinder_sys_admin.helper_command = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] cinder_sys_admin.user = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] service_user.auth_section = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] service_user.auth_type = password {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] service_user.cafile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] service_user.certfile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] service_user.collect_timing = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] service_user.insecure = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] service_user.keyfile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] service_user.send_service_user_token = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] CMD "mount.quobyte" returned: 1 in 0.085s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] service_user.split_loggers = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] service_user.timeout = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:08:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance.auth_section = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance.auth_type = password {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance.certfile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance.collect_timing = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance.insecure = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance.keyfile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance.region_name = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:17 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance.split_loggers = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] glance.timeout = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.backend_availability_zone = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.chap_password = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.chap_username = {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.disk_geometry = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.driver_client_cert = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.driver_client_cert_key = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.driver_data_namespace = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.driver_use_ssl = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.enable_unsupported_driver = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.extra_capabilities = {} {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.filter_function = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.goodness_function = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.iscsi_target_flags = {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.iscsi_write_cache = on {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.iser_helper = tgtadm {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.iser_ip_address = 192.168.122.136 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.iser_port = 3260 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.nas_host = {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.nas_login = admin {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.nas_mount_options = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.nas_password = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.nas_private_key = {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.nas_share_path = {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.nas_ssh_port = 22 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.num_shell_tries = 3 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.nvmet_port_id = 1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.quobyte_client_cfg = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.quobyte_volume_url = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.replication_device = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.report_discard_supported = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.reserved_percentage = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.scst_target_driver = iscsi {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.scst_target_iqn_name = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.storage_protocol = iSCSI {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.target_helper = tgtadm {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.target_ip_address = 192.168.122.136 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.target_port = 3260 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.target_protocol = iscsi {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.trace_flags = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.unique_fqdn_network = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.use_chap_auth = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.volume_backend_name = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.volume_clear = zero {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.volume_clear_ionice = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.volume_clear_size = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_reports.file_event_handler = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_reports.log_dir = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.backend_availability_zone = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.backend_host = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.chap_password = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.chap_username = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.chiscsi_conf = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.disk_geometry = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.driver_client_cert = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.driver_client_cert_key = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.driver_data_namespace = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.driver_use_ssl = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.extra_capabilities = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.filter_function = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.goodness_function = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.iscsi_target_flags = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.iscsi_write_cache = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.iser_helper = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.iser_ip_address = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.iser_port = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.iser_target_prefix = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.nas_host = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.nas_login = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.nas_mount_options = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.nas_password = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.nas_private_key = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.nas_share_path = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.nas_ssh_port = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.num_shell_tries = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.nvmet_ns_id = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.nvmet_port_id = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.replication_device = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.report_discard_supported = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.reserved_percentage = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.scst_target_driver = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.storage_protocol = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.target_helper = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.target_ip_address = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.target_port = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.target_prefix = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.target_protocol = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.trace_flags = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.unique_fqdn_network = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.use_chap_auth = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.volume_clear = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.volume_clear_ionice = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.volume_clear_size = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] QuobyteHD.volumes_dir = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack sudo[86504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack sudo[86504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.ssl = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.ssl_version = {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_notifications.driver = [] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_notifications.retry = -1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] oslo_messaging_notifications.transport_url = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] key_manager.fixed_key = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican.barbican_api_version = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican.barbican_endpoint = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican.barbican_endpoint_type = public {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican.barbican_region_name = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican.cafile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican.certfile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican.collect_timing = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican.insecure = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican.keyfile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican.number_of_retries = 60 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican.retry_delay = 1 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican.send_service_user_token = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican.split_loggers = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican.timeout = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican.verify_ssl = True {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican.verify_ssl_path = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican_service_user.auth_section = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican_service_user.auth_type = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican_service_user.cafile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican_service_user.certfile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican_service_user.collect_timing = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican_service_user.insecure = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican_service_user.keyfile = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican_service_user.split_loggers = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] barbican_service_user.timeout = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] vault.approle_role_id = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] vault.approle_secret_id = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] vault.kv_mountpoint = secret {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] vault.kv_path = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] vault.kv_version = 2 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] vault.namespace = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] vault.root_token_id = **** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] vault.ssl_ca_crt_file = None {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] vault.timeout = 60.0 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] vault.use_ssl = False {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 16:08:18 devstack cinder-volume[86210]: DEBUG oslo_service.backend._eventlet.service [None req-77d48409-ab4e-4ea1-82af-687a8f1eefca None None] ******************************************************************************** {{(pid=86210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 02 16:08:18 devstack sudo[86504]: pam_unix(sudo:session): session closed for user root Jun 02 16:08:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.606s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:08:18 devstack cinder-volume[86488]: INFO cinder.volume.driver [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Driver hasn't implemented _init_vendor_properties() Jun 02 16:08:18 devstack cinder-volume[86488]: DEBUG cinder.volume.driver [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757984161377, 'free_capacity_gb': 1775.757984161377, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86488) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 02 16:08:18 devstack cinder-volume[86488]: DEBUG oslo_db.sqlalchemy.engines [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86488) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 16:08:18 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writer thread running {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 16:08:18 devstack cinder-volume[86488]: DEBUG cinder.db.sqlalchemy.api [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Building query based on filter {{(pid=86488) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 02 16:08:18 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86488) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 02 16:08:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:08:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:08:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:08:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:08:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:08:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:08:18 devstack cinder-volume[86488]: INFO cinder.keymgr.migration [None req-9e975087-1013-48b5-9ba4-1b088513f77d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 02 16:08:18 devstack sudo[86515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:08:18 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:08:19 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root Jun 02 16:08:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.578s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:08:19 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:08:19 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Driver initialization completed successfully. Jun 02 16:08:19 devstack cinder-volume[86488]: INFO cinder.manager [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Initiating service 3 cleanup Jun 02 16:08:19 devstack cinder-volume[86488]: INFO cinder.manager [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Service 3 cleanup completed. Jun 02 16:08:19 devstack cinder-volume[86488]: DEBUG cinder.service [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Creating RPC server for service cinder-volume {{(pid=86488) start /opt/stack/cinder/cinder/service.py:231}} Jun 02 16:08:19 devstack cinder-volume[86488]: DEBUG cinder.service [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86488) start /opt/stack/cinder/cinder/service.py:237}} Jun 02 16:08:19 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 02 16:08:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:08:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:08:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:08:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:08:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:08:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:08:19 devstack sudo[86536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:08:19 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:08:19 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root Jun 02 16:08:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.563s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:08:20 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-08683e48-bb4e-4808-a675-f61b55905cbd None None] Driver post RPC initialization completed successfully. Jun 02 16:08:27 devstack cinder-volume[86210]: DEBUG dbcounter [-] [86210] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86210) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:08:29 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=2 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:08:30 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Flow 'volume_create_manager' (49a012a0-c105-44ee-9e46-6f48a8c3a60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea5455d-54f9-4c4e-9d77-3a2a2c1952c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea5455d-54f9-4c4e-9d77-3a2a2c1952c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1293588019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a61af0a-0f80-4b59-9d56-b3d5e4031142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18c9100595d408caac374cada4d4b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:09:43Z,use_quota=True,user_id='ff7fbebbbe4c4b60be151b123fd20041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c553aa7-c82b-4212-910a-fddb9db14733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c553aa7-c82b-4212-910a-fddb9db14733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e00f34b-33d1-4538-abb8-d2fa7f8f0e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e00f34b-33d1-4538-abb8-d2fa7f8f0e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a61af0a-0f80-4b59-9d56-b3d5e4031142', 'volume_name': 'volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35500f7f-419b-4d04-8dbb-b808d6721574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35500f7f-419b-4d04-8dbb-b808d6721574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a262aac-19c2-4826-9b88-a4751b12ca00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:43 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Volume 3a61af0a-0f80-4b59-9d56-b3d5e4031142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142', 'volume_size': 1} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1293588019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a61af0a-0f80-4b59-9d56-b3d5e4031142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18c9100595d408caac374cada4d4b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:09:43Z,use_quota=True,user_id='ff7fbebbbe4c4b60be151b123fd20041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Creating volume 3a61af0a-0f80-4b59-9d56-b3d5e4031142 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:09:43 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:09:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:09:43 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142 1073741824 Jun 02 16:09:43 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:09:44 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:09:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Flow 'volume_create_manager' (1c949f04-fd41-493b-a564-90d8b2555850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:09:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905e840e-4ba6-4736-a6b2-971016a4685e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905e840e-4ba6-4736-a6b2-971016a4685e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1387458555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47b3829-7bc4-4e35-87e8-bbb86d19d21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346fa2135aa444689d41a23d23059e03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:09:44Z,use_quota=True,user_id='39d78414797e4436b26de209e5cc171a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec14fcb9-0d89-4a92-8371-e719baa3f0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec14fcb9-0d89-4a92-8371-e719baa3f0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd46a91-42a9-4336-9cb0-25452b7227f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd46a91-42a9-4336-9cb0-25452b7227f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f47b3829-7bc4-4e35-87e8-bbb86d19d21f', 'volume_name': 'volume-f47b3829-7bc4-4e35-87e8-bbb86d19d21f', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd874f7-dc60-4996-ab3a-1ac6fb0b0a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd874f7-dc60-4996-ab3a-1ac6fb0b0a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af19352-cd2e-4576-8dd4-d4541db97b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:44 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Volume f47b3829-7bc4-4e35-87e8-bbb86d19d21f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f47b3829-7bc4-4e35-87e8-bbb86d19d21f', 'volume_size': 1} Jun 02 16:09:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:09:44 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Jun 02 16:09:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142 1073741824" returned: 0 in 1.282s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:09:45 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142 Jun 02 16:09:45 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:09:45 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142" returned: 0 in 0.802s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] <== create_volume: return (2144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.146s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.438s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1387458555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47b3829-7bc4-4e35-87e8-bbb86d19d21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346fa2135aa444689d41a23d23059e03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:09:44Z,use_quota=True,user_id='39d78414797e4436b26de209e5cc171a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Creating volume f47b3829-7bc4-4e35-87e8-bbb86d19d21f {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:09:45 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f47b3829-7bc4-4e35-87e8-bbb86d19d21f 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a262aac-19c2-4826-9b88-a4751b12ca00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a254b9d4-ba25-4ebe-a6e8-42fcef3c12f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:45 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f47b3829-7bc4-4e35-87e8-bbb86d19d21f 1073741824 Jun 02 16:09:45 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:09:45 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Volume volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142 (3a61af0a-0f80-4b59-9d56-b3d5e4031142): created successfully Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a254b9d4-ba25-4ebe-a6e8-42fcef3c12f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Flow 'volume_create_manager' (49a012a0-c105-44ee-9e46-6f48a8c3a60f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:09:45 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-e83dea85-ddd1-445b-be93-3e159b737af7 tempest-DeleteServersTestJSON-1038891447 None] Created volume successfully. Jun 02 16:09:46 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Jun 02 16:09:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f47b3829-7bc4-4e35-87e8-bbb86d19d21f 1073741824" returned: 0 in 0.994s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:09:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f47b3829-7bc4-4e35-87e8-bbb86d19d21f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:09:46 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f47b3829-7bc4-4e35-87e8-bbb86d19d21f Jun 02 16:09:46 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:09:47 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Jun 02 16:09:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f47b3829-7bc4-4e35-87e8-bbb86d19d21f" returned: 0 in 0.897s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:09:47 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:09:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:09:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af19352-cd2e-4576-8dd4-d4541db97b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f47b3829-7bc4-4e35-87e8-bbb86d19d21f', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abc88ba-defd-46ce-9d9e-c7228e4f146e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:47 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Volume volume-f47b3829-7bc4-4e35-87e8-bbb86d19d21f (f47b3829-7bc4-4e35-87e8-bbb86d19d21f): created successfully Jun 02 16:09:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abc88ba-defd-46ce-9d9e-c7228e4f146e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Flow 'volume_create_manager' (1c949f04-fd41-493b-a564-90d8b2555850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:09:47 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-17cb3aa6-37c9-46a4-8738-9166ebe8026d tempest-VolumesAdminNegativeTest-1452394361 None] Created volume successfully. Jun 02 16:09:49 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Acquiring lock "cinder-f47b3829-7bc4-4e35-87e8-bbb86d19d21f-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:09:49 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Lock "cinder-f47b3829-7bc4-4e35-87e8-bbb86d19d21f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:09:49 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Acquiring lock "cinder-quobyte-f47b3829-7bc4-4e35-87e8-bbb86d19d21f" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:09:49 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Lock "cinder-quobyte-f47b3829-7bc4-4e35-87e8-bbb86d19d21f" acquired by "delete_volume" :: waited 0.047s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:09:49 devstack cinder-volume[86488]: INFO oslo.privsep.daemon [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgfsugctc/privsep.sock'] Jun 02 16:09:49 devstack sudo[87710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgfsugctc/privsep.sock Jun 02 16:09:49 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:09:51 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root Jun 02 16:09:51 devstack cinder-volume[86488]: INFO oslo.privsep.daemon [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Spawned new privsep daemon via rootwrap Jun 02 16:09:51 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Accepted privsep connection to /tmp/tmpgfsugctc/privsep.sock {{(pid=86488) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Jun 02 16:09:51 devstack cinder-volume[86488]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 02 16:09:51 devstack cinder-volume[86488]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 02 16:09:51 devstack cinder-volume[86488]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 02 16:09:51 devstack cinder-volume[86488]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87714 Jun 02 16:09:51 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bb1cfb-29e5-452b-b8ae-aac6cfc9daae]: (2,) {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:09:51 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6b3b28-7c02-4ad8-918f-d43133a2ee5f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:09:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f47b3829-7bc4-4e35-87e8-bbb86d19d21f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:09:52 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f47b3829-7bc4-4e35-87e8-bbb86d19d21f Jun 02 16:09:52 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:09:53 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Jun 02 16:09:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f47b3829-7bc4-4e35-87e8-bbb86d19d21f" returned: 0 in 1.356s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:09:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f47b3829-7bc4-4e35-87e8-bbb86d19d21f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:09:53 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f47b3829-7bc4-4e35-87e8-bbb86d19d21f Jun 02 16:09:53 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:09:54 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Flow 'volume_create_manager' (6c3da9cb-6614-4319-8536-17df33a92735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec2b58a-eedb-479b-8a60-cd82768371c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f47b3829-7bc4-4e35-87e8-bbb86d19d21f" returned: 0 in 0.956s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Lock "cinder-quobyte-f47b3829-7bc4-4e35-87e8-bbb86d19d21f" released by "delete_volume" :: held 4.752s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec2b58a-eedb-479b-8a60-cd82768371c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-625425083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781356f7-4f3f-4a35-bc6e-d5c6bb4bad22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f784546c47d0468d99de80bb5efd2236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:09:54Z,use_quota=True,user_id='a43e6014c25d4814873dc693ca69af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (852045cd-49c0-48ba-850b-dc15648d242c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (852045cd-49c0-48ba-850b-dc15648d242c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8164a042-04b4-4e54-a3b7-90e69f4f80fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8164a042-04b4-4e54-a3b7-90e69f4f80fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '781356f7-4f3f-4a35-bc6e-d5c6bb4bad22', 'volume_name': 'volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049cf6ed-6e6f-4bed-ab44-c7106e411a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049cf6ed-6e6f-4bed-ab44-c7106e411a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f5e78c-8974-426a-a1ad-f828fe48d24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:54 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Volume 781356f7-4f3f-4a35-bc6e-d5c6bb4bad22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22', 'volume_size': 1} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-625425083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781356f7-4f3f-4a35-bc6e-d5c6bb4bad22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f784546c47d0468d99de80bb5efd2236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:09:54Z,use_quota=True,user_id='a43e6014c25d4814873dc693ca69af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Creating volume 781356f7-4f3f-4a35-bc6e-d5c6bb4bad22 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:09:54 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:09:54 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22 1073741824 Jun 02 16:09:54 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:09:54 devstack cinder-volume[86488]: WARNING cinder.quota [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:09:54 devstack cinder-volume[86488]: WARNING cinder.quota [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Created reservations ['fa69a269-d8bb-46f6-b931-58d98d3c1908', '41c398ac-0a00-490a-8895-8bded678bd52', '5f46269c-10cc-447f-bb8f-900ed6be70c8', '15e001dd-f86c-42c3-ae68-16b4c45f78fe'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:09:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:09:54 devstack sudo[87741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:09:54 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:09:55 devstack cinder-volume[86488]: WARNING py.warnings [req-f85adf66-981d-43ca-ad6c-a485cd3074bd req-02432991-33eb-4d65-b5ce-c0702ff4e3a6 tempest-DeleteServersTestJSON-1038891447 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jun 02 16:09:55 devstack cinder-volume[86488]: .first() Jun 02 16:09:55 devstack cinder-volume[86488]: Jun 02 16:09:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-f85adf66-981d-43ca-ad6c-a485cd3074bd req-02432991-33eb-4d65-b5ce-c0702ff4e3a6 tempest-DeleteServersTestJSON-1038891447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:09:56 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Jun 02 16:09:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22 1073741824" returned: 0 in 1.917s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:09:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:09:56 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root Jun 02 16:09:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.574s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:09:56 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:09:56 devstack sudo[87758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22 Jun 02 16:09:56 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Deleted volume successfully. Jun 02 16:09:56 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:09:56 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4f3abfb6-7d7d-4a40-aed6-07ad557a1559 tempest-VolumesAdminNegativeTest-1452394361 None] Lock "cinder-f47b3829-7bc4-4e35-87e8-bbb86d19d21f-delete_volume" released by "delete_volume" :: held 7.239s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:09:57 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root Jun 02 16:09:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22" returned: 0 in 1.197s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:09:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] <== create_volume: return (3339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:09:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.341s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:09:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-f85adf66-981d-43ca-ad6c-a485cd3074bd req-02432991-33eb-4d65-b5ce-c0702ff4e3a6 tempest-DeleteServersTestJSON-1038891447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.868s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:09:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f5e78c-8974-426a-a1ad-f828fe48d24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e509d7-96ea-4f56-a062-ea5941f97fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:09:57 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b818467b-f6e2-4edb-a39e-0218962b5c20]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:09:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-f85adf66-981d-43ca-ad6c-a485cd3074bd req-02432991-33eb-4d65-b5ce-c0702ff4e3a6 tempest-DeleteServersTestJSON-1038891447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:09:57 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Volume volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22 (781356f7-4f3f-4a35-bc6e-d5c6bb4bad22): created successfully Jun 02 16:09:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e509d7-96ea-4f56-a062-ea5941f97fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:09:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Flow 'volume_create_manager' (6c3da9cb-6614-4319-8536-17df33a92735) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:09:57 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-fbdfa95d-7728-412f-853c-a17b5b604e50 tempest-AttachVolumeTestJSON-1360013176 None] Created volume successfully. Jun 02 16:09:57 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142 Jun 02 16:09:57 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:09:58 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Jun 02 16:09:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-f85adf66-981d-43ca-ad6c-a485cd3074bd req-02432991-33eb-4d65-b5ce-c0702ff4e3a6 tempest-DeleteServersTestJSON-1038891447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142" returned: 0 in 1.075s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:09:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-f85adf66-981d-43ca-ad6c-a485cd3074bd req-02432991-33eb-4d65-b5ce-c0702ff4e3a6 tempest-DeleteServersTestJSON-1038891447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.125s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:09:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-f85adf66-981d-43ca-ad6c-a485cd3074bd req-02432991-33eb-4d65-b5ce-c0702ff4e3a6 tempest-DeleteServersTestJSON-1038891447 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8909bc0b-9251-4a22-be77-96713a3f7c9e', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:09:58 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-f85adf66-981d-43ca-ad6c-a485cd3074bd req-02432991-33eb-4d65-b5ce-c0702ff4e3a6 tempest-DeleteServersTestJSON-1038891447 None] attachment_update completed successfully. Jun 02 16:10:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:10:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:10:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:10:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:10:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:10:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:10:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:10:00 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:10:00 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:10:00 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Jun 02 16:10:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.759s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:10:00 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:10:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-658edbf1-55dc-4c07-906e-0ee963cc29d7 req-5b40f7fd-d5db-41d4-82ad-e69720ca1aa0 tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:10:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-658edbf1-55dc-4c07-906e-0ee963cc29d7 req-5b40f7fd-d5db-41d4-82ad-e69720ca1aa0 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:10:02 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09f1158-a0a1-4c2f-baef-e91a8ff0dfa5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:10:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-658edbf1-55dc-4c07-906e-0ee963cc29d7 req-5b40f7fd-d5db-41d4-82ad-e69720ca1aa0 tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:10:02 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22 Jun 02 16:10:02 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:10:03 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Jun 02 16:10:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-658edbf1-55dc-4c07-906e-0ee963cc29d7 req-5b40f7fd-d5db-41d4-82ad-e69720ca1aa0 tempest-AttachVolumeTestJSON-1360013176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22" returned: 0 in 0.978s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:10:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-658edbf1-55dc-4c07-906e-0ee963cc29d7 req-5b40f7fd-d5db-41d4-82ad-e69720ca1aa0 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.998s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:10:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-658edbf1-55dc-4c07-906e-0ee963cc29d7 req-5b40f7fd-d5db-41d4-82ad-e69720ca1aa0 tempest-AttachVolumeTestJSON-1360013176 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbf75433-ece2-4fa9-8303-87a149f72ef9', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:10:03 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-658edbf1-55dc-4c07-906e-0ee963cc29d7 req-5b40f7fd-d5db-41d4-82ad-e69720ca1aa0 tempest-AttachVolumeTestJSON-1360013176 None] attachment_update completed successfully. Jun 02 16:10:07 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-601d75b1-4ca9-4683-95bc-e3ee75fa4b92 req-84e334b5-77f2-42de-a09c-64af79b61c1a tempest-DeleteServersTestJSON-1038891447 None] Terminate volume connection completed successfully. Jun 02 16:10:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-601d75b1-4ca9-4683-95bc-e3ee75fa4b92 req-84e334b5-77f2-42de-a09c-64af79b61c1a tempest-DeleteServersTestJSON-1038891447 None] Deleting attachment 8909bc0b-9251-4a22-be77-96713a3f7c9e. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:10:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] Acquiring lock "cinder-3a61af0a-0f80-4b59-9d56-b3d5e4031142-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:10:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] Lock "cinder-3a61af0a-0f80-4b59-9d56-b3d5e4031142-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:10:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] Acquiring lock "cinder-quobyte-3a61af0a-0f80-4b59-9d56-b3d5e4031142" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:10:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] Lock "cinder-quobyte-3a61af0a-0f80-4b59-9d56-b3d5e4031142" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:10:12 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18ebaee-3939-4361-8e41-1a9934b6ea96]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:10:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:10:13 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142 Jun 02 16:10:13 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:10:13 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Jun 02 16:10:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142" returned: 0 in 0.860s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:10:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:10:13 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142 Jun 02 16:10:13 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:10:14 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Jun 02 16:10:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a61af0a-0f80-4b59-9d56-b3d5e4031142" returned: 0 in 0.602s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:10:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] Lock "cinder-quobyte-3a61af0a-0f80-4b59-9d56-b3d5e4031142" released by "delete_volume" :: held 1.531s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:10:14 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] Created reservations ['04d7c788-0077-451d-a6f6-4c6f7700604d', '84edd67f-d2bc-4fc3-8687-63e1eb002ec5', 'afd806eb-e33c-43bb-9937-e6bd507c75fa', '9181f676-10ce-4f78-80d2-7d0a57014197'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:10:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:10:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:10:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:10:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:10:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:10:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:10:14 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:10:14 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:10:15 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Jun 02 16:10:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.670s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:10:15 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:10:15 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] Deleted volume successfully. Jun 02 16:10:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-959f90a5-dcae-44e9-97c0-435c93a6c804 tempest-DeleteServersTestJSON-1038891447 None] Lock "cinder-3a61af0a-0f80-4b59-9d56-b3d5e4031142-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:10:30 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:UPDATE=32,cinder:SELECT=26,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:10:30 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=31,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=8 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Flow 'volume_create_manager' (6a207af3-8a1b-4f17-9893-f8e8c2b49b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc32912e-ce94-45bc-ab9f-9d9bf8058129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc32912e-ce94-45bc-ab9f-9d9bf8058129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-581043144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9abedbd5-25f3-4309-aada-a1a884872d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57789396bd1427baac658c7f086d46e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:10:48Z,use_quota=True,user_id='6ded3a874c3d432885c41027c1563c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8d58b9-fda7-498c-baea-7b1e93205619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8d58b9-fda7-498c-baea-7b1e93205619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0d1452-1263-4f08-98bd-cd2d9351a182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0d1452-1263-4f08-98bd-cd2d9351a182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9abedbd5-25f3-4309-aada-a1a884872d87', 'volume_name': 'volume-9abedbd5-25f3-4309-aada-a1a884872d87', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f01756-9e1a-45b5-bcf5-5825e8da05f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f01756-9e1a-45b5-bcf5-5825e8da05f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fba5c69-f781-41aa-a430-62eac7727828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:10:48 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Volume 9abedbd5-25f3-4309-aada-a1a884872d87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9abedbd5-25f3-4309-aada-a1a884872d87', 'volume_size': 1} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-581043144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9abedbd5-25f3-4309-aada-a1a884872d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57789396bd1427baac658c7f086d46e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:10:48Z,use_quota=True,user_id='6ded3a874c3d432885c41027c1563c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Creating volume 9abedbd5-25f3-4309-aada-a1a884872d87 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:10:48 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:10:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9abedbd5-25f3-4309-aada-a1a884872d87 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:10:48 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9abedbd5-25f3-4309-aada-a1a884872d87 1073741824 Jun 02 16:10:48 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:10:49 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Jun 02 16:10:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9abedbd5-25f3-4309-aada-a1a884872d87 1073741824" returned: 0 in 0.862s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:10:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9abedbd5-25f3-4309-aada-a1a884872d87 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:10:49 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9abedbd5-25f3-4309-aada-a1a884872d87 Jun 02 16:10:49 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:10:50 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Jun 02 16:10:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9abedbd5-25f3-4309-aada-a1a884872d87" returned: 0 in 0.734s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:10:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:10:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:10:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fba5c69-f781-41aa-a430-62eac7727828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9abedbd5-25f3-4309-aada-a1a884872d87', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:10:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed606245-1990-4177-8a23-0e03ae269145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:10:50 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Volume volume-9abedbd5-25f3-4309-aada-a1a884872d87 (9abedbd5-25f3-4309-aada-a1a884872d87): created successfully Jun 02 16:10:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed606245-1990-4177-8a23-0e03ae269145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:10:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Flow 'volume_create_manager' (6a207af3-8a1b-4f17-9893-f8e8c2b49b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:10:50 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-d6dea75f-b0f0-4d48-9be7-c2a987030f0f tempest-AttachVolumeNegativeTest-705416858 None] Created volume successfully. Jun 02 16:10:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-030996c4-ec46-47ca-b5ed-7f53538d0d32 req-928cce85-be2c-4445-b415-18a6e7238fc2 tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:10:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-030996c4-ec46-47ca-b5ed-7f53538d0d32 req-928cce85-be2c-4445-b415-18a6e7238fc2 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:10:53 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1d6e52-f401-43d2-9ee7-3821c8d2a6c3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:10:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-030996c4-ec46-47ca-b5ed-7f53538d0d32 req-928cce85-be2c-4445-b415-18a6e7238fc2 tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9abedbd5-25f3-4309-aada-a1a884872d87 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:10:54 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9abedbd5-25f3-4309-aada-a1a884872d87 Jun 02 16:10:54 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:10:54 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-8cf235d4-2f5a-4484-acad-f0803a15e6e1 req-6d5e7d65-ec39-4867-add6-ca064df1d085 tempest-AttachVolumeTestJSON-1360013176 None] Terminate volume connection completed successfully. Jun 02 16:10:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-8cf235d4-2f5a-4484-acad-f0803a15e6e1 req-6d5e7d65-ec39-4867-add6-ca064df1d085 tempest-AttachVolumeTestJSON-1360013176 None] Deleting attachment cbf75433-ece2-4fa9-8303-87a149f72ef9. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:10:54 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Jun 02 16:10:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-030996c4-ec46-47ca-b5ed-7f53538d0d32 req-928cce85-be2c-4445-b415-18a6e7238fc2 tempest-AttachVolumeNegativeTest-705416858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9abedbd5-25f3-4309-aada-a1a884872d87" returned: 0 in 1.072s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:10:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-030996c4-ec46-47ca-b5ed-7f53538d0d32 req-928cce85-be2c-4445-b415-18a6e7238fc2 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.104s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:10:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-030996c4-ec46-47ca-b5ed-7f53538d0d32 req-928cce85-be2c-4445-b415-18a6e7238fc2 tempest-AttachVolumeNegativeTest-705416858 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-9abedbd5-25f3-4309-aada-a1a884872d87', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '838bf7e9-af3d-4232-95bf-3237933528d4', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:10:55 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-030996c4-ec46-47ca-b5ed-7f53538d0d32 req-928cce85-be2c-4445-b415-18a6e7238fc2 tempest-AttachVolumeNegativeTest-705416858 None] attachment_update completed successfully. Jun 02 16:11:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:11:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:11:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:11:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:11:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:11:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:11:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:11:00 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:11:00 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:11:00 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:11:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Flow 'volume_create_manager' (97184c84-97db-4369-a219-8ee399c3f9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:11:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6bc8ee-7487-418a-9a29-ca9980b3924c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6bc8ee-7487-418a-9a29-ca9980b3924c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-670925306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73aafa15-b51b-4494-afe2-19f12728732c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f9c63f1c2a4a2589faed43ba25b1ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:11:01Z,use_quota=True,user_id='62d35fb9bf1f4d1a8f2046a87a0ab54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74a2fa2-76fb-4ef4-a5a3-fd76c4d02f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74a2fa2-76fb-4ef4-a5a3-fd76c4d02f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb9e104-f3cc-44ff-8a4e-3ee850981d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb9e104-f3cc-44ff-8a4e-3ee850981d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73aafa15-b51b-4494-afe2-19f12728732c', 'volume_name': 'volume-73aafa15-b51b-4494-afe2-19f12728732c', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8accc774-a892-472b-8abc-c78e41774788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:01 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8accc774-a892-472b-8abc-c78e41774788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4993ed4-4e2d-4fae-b315-25bc6762400e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:01 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Volume 73aafa15-b51b-4494-afe2-19f12728732c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73aafa15-b51b-4494-afe2-19f12728732c', 'volume_size': 1} Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-670925306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73aafa15-b51b-4494-afe2-19f12728732c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f9c63f1c2a4a2589faed43ba25b1ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:11:01Z,use_quota=True,user_id='62d35fb9bf1f4d1a8f2046a87a0ab54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Creating volume 73aafa15-b51b-4494-afe2-19f12728732c {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:11:01 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-73aafa15-b51b-4494-afe2-19f12728732c 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.023s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:11:01 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:11:01 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-73aafa15-b51b-4494-afe2-19f12728732c 1073741824 Jun 02 16:11:01 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:11:02 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Jun 02 16:11:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-73aafa15-b51b-4494-afe2-19f12728732c 1073741824" returned: 0 in 1.143s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:11:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-73aafa15-b51b-4494-afe2-19f12728732c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:11:02 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-73aafa15-b51b-4494-afe2-19f12728732c Jun 02 16:11:02 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:11:03 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Jun 02 16:11:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-73aafa15-b51b-4494-afe2-19f12728732c" returned: 0 in 1.175s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:11:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] <== create_volume: return (2396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:11:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.398s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:11:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4993ed4-4e2d-4fae-b315-25bc6762400e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73aafa15-b51b-4494-afe2-19f12728732c', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b15cc8-0df9-423f-b857-9d9654e63585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:03 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Volume volume-73aafa15-b51b-4494-afe2-19f12728732c (73aafa15-b51b-4494-afe2-19f12728732c): created successfully Jun 02 16:11:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b15cc8-0df9-423f-b857-9d9654e63585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Flow 'volume_create_manager' (97184c84-97db-4369-a219-8ee399c3f9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:11:03 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-6dddb54e-865b-4bcf-9c12-8ac206f14e68 tempest-TaggedAttachmentsTest-1782568348 None] Created volume successfully. Jun 02 16:11:13 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:11:13 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:UPDATE=7,cinder:SELECT=12,cinder:DELETE=1 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:11:23 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:11:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Flow 'volume_create_manager' (a754b1cc-5ddc-4f4d-a1a5-0dbca4603b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:11:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5077c099-bebe-49c2-8939-9a5f17e2d810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5077c099-bebe-49c2-8939-9a5f17e2d810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1741105318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af74e2b-a791-4920-9436-5f0772bbb24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f7f2331f2e490bacc6db714a404246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:11:24Z,use_quota=True,user_id='a811385a80254d1aac915ab909988fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51ead47-cc09-4640-95cc-347e2cd2c6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51ead47-cc09-4640-95cc-347e2cd2c6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40bd2e8a-16f8-4ba9-aefa-517416d96ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40bd2e8a-16f8-4ba9-aefa-517416d96ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af74e2b-a791-4920-9436-5f0772bbb24c', 'volume_name': 'volume-6af74e2b-a791-4920-9436-5f0772bbb24c', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe9685e-85f6-4303-ad94-b34ab6e3489e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe9685e-85f6-4303-ad94-b34ab6e3489e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3026d46-7dc2-40e1-bc16-1e3b85592a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:24 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Volume 6af74e2b-a791-4920-9436-5f0772bbb24c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af74e2b-a791-4920-9436-5f0772bbb24c', 'volume_size': 1} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1741105318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af74e2b-a791-4920-9436-5f0772bbb24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f7f2331f2e490bacc6db714a404246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:11:24Z,use_quota=True,user_id='a811385a80254d1aac915ab909988fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Creating volume 6af74e2b-a791-4920-9436-5f0772bbb24c {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:11:24 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:11:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6af74e2b-a791-4920-9436-5f0772bbb24c 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:11:24 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6af74e2b-a791-4920-9436-5f0772bbb24c 1073741824 Jun 02 16:11:24 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:11:26 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Jun 02 16:11:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6af74e2b-a791-4920-9436-5f0772bbb24c 1073741824" returned: 0 in 1.979s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:11:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6af74e2b-a791-4920-9436-5f0772bbb24c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:11:26 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6af74e2b-a791-4920-9436-5f0772bbb24c Jun 02 16:11:26 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:11:27 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Jun 02 16:11:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6af74e2b-a791-4920-9436-5f0772bbb24c" returned: 0 in 0.775s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:11:27 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] <== create_volume: return (2884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:11:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.891s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:11:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3026d46-7dc2-40e1-bc16-1e3b85592a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af74e2b-a791-4920-9436-5f0772bbb24c', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eed8e27-0e99-40b7-9124-f81040e13f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:27 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Volume volume-6af74e2b-a791-4920-9436-5f0772bbb24c (6af74e2b-a791-4920-9436-5f0772bbb24c): created successfully Jun 02 16:11:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eed8e27-0e99-40b7-9124-f81040e13f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Flow 'volume_create_manager' (a754b1cc-5ddc-4f4d-a1a5-0dbca4603b3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:11:27 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f1bc73c7-8e0c-48db-b022-deaf93e61611 tempest-ServersNegativeTestJSON-1209342344 None] Created volume successfully. Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Flow 'volume_create_manager' (0cf08b13-88b0-4cee-b08d-6cdb8e9128f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c792f4-c87b-49a0-b65a-ec994c34c241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c792f4-c87b-49a0-b65a-ec994c34c241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-37939173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc68cfb-a76e-422d-af57-76b126bda1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f7f2331f2e490bacc6db714a404246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:11:29Z,use_quota=True,user_id='a811385a80254d1aac915ab909988fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c371b926-4e0a-4200-971c-2586387a7537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c371b926-4e0a-4200-971c-2586387a7537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23f5b50-ed95-44d1-9e99-87fc7b1f0609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23f5b50-ed95-44d1-9e99-87fc7b1f0609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc68cfb-a76e-422d-af57-76b126bda1be', 'volume_name': 'volume-1fc68cfb-a76e-422d-af57-76b126bda1be', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319f8045-cfea-4a3f-a4d9-5bd9b65b5365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319f8045-cfea-4a3f-a4d9-5bd9b65b5365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061b5142-7c1b-4b34-bf29-c2dd6041ec07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:29 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Volume 1fc68cfb-a76e-422d-af57-76b126bda1be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc68cfb-a76e-422d-af57-76b126bda1be', 'volume_size': 1} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-37939173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc68cfb-a76e-422d-af57-76b126bda1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f7f2331f2e490bacc6db714a404246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:11:29Z,use_quota=True,user_id='a811385a80254d1aac915ab909988fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Creating volume 1fc68cfb-a76e-422d-af57-76b126bda1be {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:11:29 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:11:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1fc68cfb-a76e-422d-af57-76b126bda1be 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:11:29 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1fc68cfb-a76e-422d-af57-76b126bda1be 1073741824 Jun 02 16:11:29 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:11:30 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Jun 02 16:11:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1fc68cfb-a76e-422d-af57-76b126bda1be 1073741824" returned: 0 in 1.178s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:11:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1fc68cfb-a76e-422d-af57-76b126bda1be {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:11:30 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1fc68cfb-a76e-422d-af57-76b126bda1be Jun 02 16:11:30 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:11:31 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Jun 02 16:11:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1fc68cfb-a76e-422d-af57-76b126bda1be" returned: 0 in 0.810s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:11:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:11:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:11:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061b5142-7c1b-4b34-bf29-c2dd6041ec07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc68cfb-a76e-422d-af57-76b126bda1be', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d20fcfe-dce5-4a4e-95e7-4bccedd28093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:11:31 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Volume volume-1fc68cfb-a76e-422d-af57-76b126bda1be (1fc68cfb-a76e-422d-af57-76b126bda1be): created successfully Jun 02 16:11:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d20fcfe-dce5-4a4e-95e7-4bccedd28093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:11:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Flow 'volume_create_manager' (0cf08b13-88b0-4cee-b08d-6cdb8e9128f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:11:31 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-b81a4cc7-39dc-4e16-aab4-0a4a0cf279cc tempest-ServersNegativeTestJSON-1209342344 None] Created volume successfully. Jun 02 16:11:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] Acquiring lock "cinder-1fc68cfb-a76e-422d-af57-76b126bda1be-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:11:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] Lock "cinder-1fc68cfb-a76e-422d-af57-76b126bda1be-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:11:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] Acquiring lock "cinder-quobyte-1fc68cfb-a76e-422d-af57-76b126bda1be" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:11:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] Lock "cinder-quobyte-1fc68cfb-a76e-422d-af57-76b126bda1be" acquired by "delete_volume" :: waited 0.031s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:11:32 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4104d90a-7f82-4a7a-8220-b4363d93674a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:11:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1fc68cfb-a76e-422d-af57-76b126bda1be {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:11:33 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1fc68cfb-a76e-422d-af57-76b126bda1be Jun 02 16:11:33 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:11:33 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Jun 02 16:11:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1fc68cfb-a76e-422d-af57-76b126bda1be" returned: 0 in 0.827s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:11:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1fc68cfb-a76e-422d-af57-76b126bda1be {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:11:33 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1fc68cfb-a76e-422d-af57-76b126bda1be Jun 02 16:11:33 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:11:34 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Jun 02 16:11:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1fc68cfb-a76e-422d-af57-76b126bda1be" returned: 0 in 0.696s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:11:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] Lock "cinder-quobyte-1fc68cfb-a76e-422d-af57-76b126bda1be" released by "delete_volume" :: held 1.578s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:11:34 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] Created reservations ['82b5d409-0704-49d8-ae1f-3b2c4d7391c1', 'e8706264-0a99-4d26-a02d-4f089325ea59', 'bd5c33a0-124a-4785-8859-d2ae17cc7166', '3f212e1b-83a2-4e5d-b8d1-e70d66f40f10'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:11:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:11:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:11:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:11:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:11:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:11:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:11:34 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:11:34 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:11:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] Acquiring lock "cinder-6af74e2b-a791-4920-9436-5f0772bbb24c-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:11:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] Lock "cinder-6af74e2b-a791-4920-9436-5f0772bbb24c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:11:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] Acquiring lock "cinder-quobyte-6af74e2b-a791-4920-9436-5f0772bbb24c" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:11:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] Lock "cinder-quobyte-6af74e2b-a791-4920-9436-5f0772bbb24c" acquired by "delete_volume" :: waited 0.037s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:11:35 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[98488c5b-62b6-41e9-aa09-a7c650d72a16]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:11:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6af74e2b-a791-4920-9436-5f0772bbb24c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:11:35 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Jun 02 16:11:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.701s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:11:35 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:11:35 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] Deleted volume successfully. Jun 02 16:11:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ba36d8b4-bc32-4ec4-92e8-d3f64dab393a tempest-ServersNegativeTestJSON-1209342344 None] Lock "cinder-1fc68cfb-a76e-422d-af57-76b126bda1be-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:11:35 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6af74e2b-a791-4920-9436-5f0772bbb24c Jun 02 16:11:35 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:11:36 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Jun 02 16:11:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6af74e2b-a791-4920-9436-5f0772bbb24c" returned: 0 in 0.931s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:11:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6af74e2b-a791-4920-9436-5f0772bbb24c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:11:36 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6af74e2b-a791-4920-9436-5f0772bbb24c Jun 02 16:11:36 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:11:37 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Jun 02 16:11:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6af74e2b-a791-4920-9436-5f0772bbb24c" returned: 0 in 0.860s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:11:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] Lock "cinder-quobyte-6af74e2b-a791-4920-9436-5f0772bbb24c" released by "delete_volume" :: held 1.853s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:11:37 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] Created reservations ['13ba3028-ab52-436d-97b9-c5ef1a6b4af9', '1a56a034-49c5-4fe8-b3dd-542f89388b11', 'b9f93801-d91b-4754-b051-e24460946a68', 'c180b29b-d632-4674-8410-f7b6cb9e5839'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:11:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:11:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:11:37 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:11:37 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:11:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:11:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:11:37 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:11:37 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:11:38 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Jun 02 16:11:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.333s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:11:38 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:11:38 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] Deleted volume successfully. Jun 02 16:11:38 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9265cdd4-9b8a-4a8e-97ba-14ce45be0ded tempest-ServersNegativeTestJSON-1209342344 None] Lock "cinder-6af74e2b-a791-4920-9436-5f0772bbb24c-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:11:47 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=13,cinder:UPDATE=22,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:11:48 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=15,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:12:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:12:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:12:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:12:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:12:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:12:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:12:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:12:00 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:12:00 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:12:00 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Jun 02 16:12:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.611s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:12:00 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:12:03 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-cd55d74c-df76-4076-aa7a-4906bdaf625b req-285456d8-8d8c-49a2-8684-b9317e66610c tempest-AttachVolumeNegativeTest-705416858 None] Terminate volume connection completed successfully. Jun 02 16:12:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-cd55d74c-df76-4076-aa7a-4906bdaf625b req-285456d8-8d8c-49a2-8684-b9317e66610c tempest-AttachVolumeNegativeTest-705416858 None] Deleting attachment 838bf7e9-af3d-4232-95bf-3237933528d4. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:12:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-08d307ca-5561-48e2-9e5e-8f531e3d93a1 req-54e690cd-586a-4f61-a34e-2d910c55a4a3 tempest-TaggedAttachmentsTest-1782568348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:12:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-08d307ca-5561-48e2-9e5e-8f531e3d93a1 req-54e690cd-586a-4f61-a34e-2d910c55a4a3 tempest-TaggedAttachmentsTest-1782568348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:12:09 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[39effc9d-c07a-4401-a91c-a141d693e4ce]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:12:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-08d307ca-5561-48e2-9e5e-8f531e3d93a1 req-54e690cd-586a-4f61-a34e-2d910c55a4a3 tempest-TaggedAttachmentsTest-1782568348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-73aafa15-b51b-4494-afe2-19f12728732c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:12:10 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-73aafa15-b51b-4494-afe2-19f12728732c Jun 02 16:12:10 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:12:11 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Jun 02 16:12:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-08d307ca-5561-48e2-9e5e-8f531e3d93a1 req-54e690cd-586a-4f61-a34e-2d910c55a4a3 tempest-TaggedAttachmentsTest-1782568348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-73aafa15-b51b-4494-afe2-19f12728732c" returned: 0 in 1.208s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:12:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-08d307ca-5561-48e2-9e5e-8f531e3d93a1 req-54e690cd-586a-4f61-a34e-2d910c55a4a3 tempest-TaggedAttachmentsTest-1782568348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.248s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:12:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-08d307ca-5561-48e2-9e5e-8f531e3d93a1 req-54e690cd-586a-4f61-a34e-2d910c55a4a3 tempest-TaggedAttachmentsTest-1782568348 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-73aafa15-b51b-4494-afe2-19f12728732c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4799ddc-dd74-455c-9c58-e2d3a480ced5', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:12:11 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-08d307ca-5561-48e2-9e5e-8f531e3d93a1 req-54e690cd-586a-4f61-a34e-2d910c55a4a3 tempest-TaggedAttachmentsTest-1782568348 None] attachment_update completed successfully. Jun 02 16:12:19 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-4337c821-707a-4166-b67f-78f494f1008e req-af060502-239d-4f66-a6fe-f3ef6627b10c tempest-TaggedAttachmentsTest-1782568348 None] Terminate volume connection completed successfully. Jun 02 16:12:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-4337c821-707a-4166-b67f-78f494f1008e req-af060502-239d-4f66-a6fe-f3ef6627b10c tempest-TaggedAttachmentsTest-1782568348 None] Deleting attachment d4799ddc-dd74-455c-9c58-e2d3a480ced5. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=6 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Flow 'volume_create_manager' (8b105008-a2c7-4512-88a5-df19a1adfd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae861de6-6361-471a-b2a2-4b8a8b9b816f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae861de6-6361-471a-b2a2-4b8a8b9b816f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-143093279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2eb839-2b5e-4225-a6f6-d3f95730cd89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f784546c47d0468d99de80bb5efd2236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:12:29Z,use_quota=True,user_id='a43e6014c25d4814873dc693ca69af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcccfeb0-a7f5-4e6f-9c80-9a987227ff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcccfeb0-a7f5-4e6f-9c80-9a987227ff3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0d9bc0-bad2-457b-81bd-e5eaca627ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0d9bc0-bad2-457b-81bd-e5eaca627ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c2eb839-2b5e-4225-a6f6-d3f95730cd89', 'volume_name': 'volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f498abf-41bc-41e2-9a9f-abfc03254cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f498abf-41bc-41e2-9a9f-abfc03254cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcefd504-3d15-4731-aeae-1442d0dfcec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:29 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Volume 0c2eb839-2b5e-4225-a6f6-d3f95730cd89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89', 'volume_size': 1} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-143093279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2eb839-2b5e-4225-a6f6-d3f95730cd89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f784546c47d0468d99de80bb5efd2236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:12:29Z,use_quota=True,user_id='a43e6014c25d4814873dc693ca69af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Creating volume 0c2eb839-2b5e-4225-a6f6-d3f95730cd89 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:12:29 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:12:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:12:29 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89 1073741824 Jun 02 16:12:29 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:12:30 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Jun 02 16:12:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89 1073741824" returned: 0 in 1.172s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:12:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:12:30 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89 Jun 02 16:12:30 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:12:31 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Jun 02 16:12:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89" returned: 0 in 1.144s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:12:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] <== create_volume: return (2405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:12:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.408s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:12:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcefd504-3d15-4731-aeae-1442d0dfcec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3958ce-2587-4ddc-b846-1eaee0570bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:31 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Volume volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89 (0c2eb839-2b5e-4225-a6f6-d3f95730cd89): created successfully Jun 02 16:12:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3958ce-2587-4ddc-b846-1eaee0570bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Flow 'volume_create_manager' (8b105008-a2c7-4512-88a5-df19a1adfd4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:12:31 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-70e14ba0-29a3-4761-a6f8-6f4f7028a537 tempest-AttachVolumeTestJSON-1360013176 None] Created volume successfully. Jun 02 16:12:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-e77b0769-fe8f-4118-8648-23c289d93fa7 req-597e7dc3-7260-486c-bc64-9de2f75ba668 tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:12:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-e77b0769-fe8f-4118-8648-23c289d93fa7 req-597e7dc3-7260-486c-bc64-9de2f75ba668 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:12:36 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[39813bdb-6ab4-4ee8-b7d4-ed0fcee00d9d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:12:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-e77b0769-fe8f-4118-8648-23c289d93fa7 req-597e7dc3-7260-486c-bc64-9de2f75ba668 tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:12:36 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89 Jun 02 16:12:36 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:12:38 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Jun 02 16:12:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-e77b0769-fe8f-4118-8648-23c289d93fa7 req-597e7dc3-7260-486c-bc64-9de2f75ba668 tempest-AttachVolumeTestJSON-1360013176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89" returned: 0 in 1.344s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:12:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-e77b0769-fe8f-4118-8648-23c289d93fa7 req-597e7dc3-7260-486c-bc64-9de2f75ba668 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.429s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:12:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-e77b0769-fe8f-4118-8648-23c289d93fa7 req-597e7dc3-7260-486c-bc64-9de2f75ba668 tempest-AttachVolumeTestJSON-1360013176 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a67b4a3-6cb9-41e8-84a6-925db8436fa9', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:12:38 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-e77b0769-fe8f-4118-8648-23c289d93fa7 req-597e7dc3-7260-486c-bc64-9de2f75ba668 tempest-AttachVolumeTestJSON-1360013176 None] attachment_update completed successfully. Jun 02 16:12:38 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] Acquiring lock "cinder-73aafa15-b51b-4494-afe2-19f12728732c-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:12:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] Lock "cinder-73aafa15-b51b-4494-afe2-19f12728732c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:12:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] Acquiring lock "cinder-quobyte-73aafa15-b51b-4494-afe2-19f12728732c" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:12:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] Lock "cinder-quobyte-73aafa15-b51b-4494-afe2-19f12728732c" acquired by "delete_volume" :: waited 0.045s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:12:39 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a68b0c7-b536-48d0-aff2-d66008ac2e7a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:12:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-73aafa15-b51b-4494-afe2-19f12728732c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:12:39 devstack sudo[91516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-73aafa15-b51b-4494-afe2-19f12728732c Jun 02 16:12:39 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:12:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-73aafa15-b51b-4494-afe2-19f12728732c" returned: 0 in 1.009s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:12:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-73aafa15-b51b-4494-afe2-19f12728732c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:12:40 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root Jun 02 16:12:40 devstack sudo[91837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-73aafa15-b51b-4494-afe2-19f12728732c Jun 02 16:12:40 devstack sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:12:41 devstack sudo[91837]: pam_unix(sudo:session): session closed for user root Jun 02 16:12:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-73aafa15-b51b-4494-afe2-19f12728732c" returned: 0 in 0.972s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:12:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] Lock "cinder-quobyte-73aafa15-b51b-4494-afe2-19f12728732c" released by "delete_volume" :: held 2.086s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:12:41 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] Created reservations ['e61eac60-4bec-48a5-856e-999f7bc36e7e', '6075e3ad-920a-48f3-bb8a-97728c036fa8', '32d411c7-73d8-4545-951d-f009012e937e', 'b2069c32-25fe-4732-a51b-272e8c511246'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:12:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:12:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:12:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:12:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:12:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:12:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:12:41 devstack sudo[91842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:12:41 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:12:42 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root Jun 02 16:12:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.955s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:12:42 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:12:42 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] Deleted volume successfully. Jun 02 16:12:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e33f0a8d-36da-4a0b-a4f1-f579d7406411 tempest-TaggedAttachmentsTest-1782568348 None] Lock "cinder-73aafa15-b51b-4494-afe2-19f12728732c-delete_volume" released by "delete_volume" :: held 3.378s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Flow 'volume_create_manager' (51375031-f5df-4e98-8e20-608bdbdc1fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95ce85d-3e6a-4584-835d-02d7439543e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95ce85d-3e6a-4584-835d-02d7439543e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1245280804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4489c0-2c0a-441d-8c05-bb7db0474233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f784546c47d0468d99de80bb5efd2236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:12:45Z,use_quota=True,user_id='a43e6014c25d4814873dc693ca69af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3bd046-41e5-4606-8c2b-9cc5d526eef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3bd046-41e5-4606-8c2b-9cc5d526eef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79ec105-d3d2-4b1c-96cb-346b953b42d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79ec105-d3d2-4b1c-96cb-346b953b42d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb4489c0-2c0a-441d-8c05-bb7db0474233', 'volume_name': 'volume-bb4489c0-2c0a-441d-8c05-bb7db0474233', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d32f32-b99f-4dba-9b0a-df2632ce045a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d32f32-b99f-4dba-9b0a-df2632ce045a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04b01f3-2c0a-4afb-8051-971d5ea544c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:44 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Volume bb4489c0-2c0a-441d-8c05-bb7db0474233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb4489c0-2c0a-441d-8c05-bb7db0474233', 'volume_size': 1} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1245280804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4489c0-2c0a-441d-8c05-bb7db0474233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f784546c47d0468d99de80bb5efd2236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:12:45Z,use_quota=True,user_id='a43e6014c25d4814873dc693ca69af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Creating volume bb4489c0-2c0a-441d-8c05-bb7db0474233 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:12:44 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:12:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-bb4489c0-2c0a-441d-8c05-bb7db0474233 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:12:45 devstack sudo[91849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-bb4489c0-2c0a-441d-8c05-bb7db0474233 1073741824 Jun 02 16:12:45 devstack sudo[91849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:12:46 devstack sudo[91849]: pam_unix(sudo:session): session closed for user root Jun 02 16:12:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-bb4489c0-2c0a-441d-8c05-bb7db0474233 1073741824" returned: 0 in 1.313s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:12:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-bb4489c0-2c0a-441d-8c05-bb7db0474233 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:12:46 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-bb4489c0-2c0a-441d-8c05-bb7db0474233 Jun 02 16:12:46 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:12:47 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Jun 02 16:12:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-bb4489c0-2c0a-441d-8c05-bb7db0474233" returned: 0 in 0.690s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:12:47 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:12:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:12:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04b01f3-2c0a-4afb-8051-971d5ea544c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb4489c0-2c0a-441d-8c05-bb7db0474233', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5b0981-5bda-4015-af8c-24623b91ff75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:47 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Volume volume-bb4489c0-2c0a-441d-8c05-bb7db0474233 (bb4489c0-2c0a-441d-8c05-bb7db0474233): created successfully Jun 02 16:12:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5b0981-5bda-4015-af8c-24623b91ff75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Flow 'volume_create_manager' (51375031-f5df-4e98-8e20-608bdbdc1fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:12:47 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-d53bde55-3868-40e2-b8a4-58c0f086029c tempest-AttachVolumeTestJSON-1360013176 None] Created volume successfully. Jun 02 16:12:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-d10ccbee-f9a3-4c9a-9c70-f488b7a71ef9 req-f1d832ba-228c-490b-a761-5cb2aca1daf9 tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:12:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-d10ccbee-f9a3-4c9a-9c70-f488b7a71ef9 req-f1d832ba-228c-490b-a761-5cb2aca1daf9 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:12:51 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7d0761-9770-4fc5-a46e-95aa3f943a6b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:12:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-d10ccbee-f9a3-4c9a-9c70-f488b7a71ef9 req-f1d832ba-228c-490b-a761-5cb2aca1daf9 tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-bb4489c0-2c0a-441d-8c05-bb7db0474233 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:12:51 devstack sudo[91910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-bb4489c0-2c0a-441d-8c05-bb7db0474233 Jun 02 16:12:51 devstack sudo[91910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:12:51 devstack sudo[91910]: pam_unix(sudo:session): session closed for user root Jun 02 16:12:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-d10ccbee-f9a3-4c9a-9c70-f488b7a71ef9 req-f1d832ba-228c-490b-a761-5cb2aca1daf9 tempest-AttachVolumeTestJSON-1360013176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-bb4489c0-2c0a-441d-8c05-bb7db0474233" returned: 0 in 0.764s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:12:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-d10ccbee-f9a3-4c9a-9c70-f488b7a71ef9 req-f1d832ba-228c-490b-a761-5cb2aca1daf9 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.787s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:12:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-d10ccbee-f9a3-4c9a-9c70-f488b7a71ef9 req-f1d832ba-228c-490b-a761-5cb2aca1daf9 tempest-AttachVolumeTestJSON-1360013176 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-bb4489c0-2c0a-441d-8c05-bb7db0474233', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9054fa2e-54c3-44db-a32b-c9f603e4c12b', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:12:52 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-d10ccbee-f9a3-4c9a-9c70-f488b7a71ef9 req-f1d832ba-228c-490b-a761-5cb2aca1daf9 tempest-AttachVolumeTestJSON-1360013176 None] attachment_update completed successfully. Jun 02 16:12:57 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=27,cinder:UPDATE=21,cinder:INSERT=2 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Flow 'volume_create_manager' (a8e0c852-e764-4f4c-bc05-8f8cdaea1b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f29f4f-a406-4761-b525-7eff22b984ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f29f4f-a406-4761-b525-7eff22b984ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-39940773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6f1b5d-2f3c-441a-9c78-e154109e97f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d913956a9dc4f6c99a5ebfb51344a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:12:58Z,use_quota=True,user_id='3254ff57b2614172ae5dbd611bc8b934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8b5297-6336-4596-8294-aec9c03796d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8b5297-6336-4596-8294-aec9c03796d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3a7a03-84ec-438d-b3ef-a83bb883aeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3a7a03-84ec-438d-b3ef-a83bb883aeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a6f1b5d-2f3c-441a-9c78-e154109e97f6', 'volume_name': 'volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408d6d0e-f48a-4669-906b-981762eed96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408d6d0e-f48a-4669-906b-981762eed96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21419118-2c0b-40dc-9d14-297b394266cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:58 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Volume 1a6f1b5d-2f3c-441a-9c78-e154109e97f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6', 'volume_size': 1} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-39940773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6f1b5d-2f3c-441a-9c78-e154109e97f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d913956a9dc4f6c99a5ebfb51344a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:12:58Z,use_quota=True,user_id='3254ff57b2614172ae5dbd611bc8b934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Creating volume 1a6f1b5d-2f3c-441a-9c78-e154109e97f6 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:12:58 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:12:58 devstack sudo[91924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6 1073741824 Jun 02 16:12:58 devstack sudo[91924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:12:58 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-68f47269-63da-4df3-9965-9c5ae06df45f req-cd05eb8e-dcb5-4e28-8f5c-c26e80f62eb3 tempest-AttachVolumeTestJSON-1360013176 None] Terminate volume connection completed successfully. Jun 02 16:12:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-68f47269-63da-4df3-9965-9c5ae06df45f req-cd05eb8e-dcb5-4e28-8f5c-c26e80f62eb3 tempest-AttachVolumeTestJSON-1360013176 None] Deleting attachment 5a67b4a3-6cb9-41e8-84a6-925db8436fa9. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:12:59 devstack sudo[91924]: pam_unix(sudo:session): session closed for user root Jun 02 16:12:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6 1073741824" returned: 0 in 0.961s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:12:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:12:59 devstack sudo[91956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6 Jun 02 16:12:59 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:12:59 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root Jun 02 16:12:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6" returned: 0 in 0.710s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:12:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:12:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:12:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21419118-2c0b-40dc-9d14-297b394266cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162c810f-f4d7-4180-b507-734f98353097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:12:59 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Volume volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6 (1a6f1b5d-2f3c-441a-9c78-e154109e97f6): created successfully Jun 02 16:12:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162c810f-f4d7-4180-b507-734f98353097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:12:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Flow 'volume_create_manager' (a8e0c852-e764-4f4c-bc05-8f8cdaea1b6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:12:59 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-93bb747c-1fb8-4fb6-b62f-8003987f5501 tempest-AttachVolumeShelveTestJSON-801041235 None] Created volume successfully. Jun 02 16:13:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:13:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:13:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:13:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:00 devstack sudo[91962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:13:00 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:00 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.866s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:00 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:13:00 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-896d3bf3-7811-4b55-a939-edf0f00e376f req-736579be-3717-43b7-8d2e-b41502cd28e5 tempest-AttachVolumeTestJSON-1360013176 None] Terminate volume connection completed successfully. Jun 02 16:13:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-896d3bf3-7811-4b55-a939-edf0f00e376f req-736579be-3717-43b7-8d2e-b41502cd28e5 tempest-AttachVolumeTestJSON-1360013176 None] Deleting attachment 9054fa2e-54c3-44db-a32b-c9f603e4c12b. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Flow 'volume_create_manager' (28feef31-ea32-46df-ba39-5389b652d563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45017491-d2fa-4316-b06e-d2a23652b5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45017491-d2fa-4316-b06e-d2a23652b5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1403043856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1f13f0-a168-4d72-8272-f4b2a2e049ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57789396bd1427baac658c7f086d46e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:13:02Z,use_quota=True,user_id='6ded3a874c3d432885c41027c1563c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0bcedd9-98a5-464d-925e-9560d0809b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0bcedd9-98a5-464d-925e-9560d0809b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb2cda7-1774-45cc-82cd-72a64db2f929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb2cda7-1774-45cc-82cd-72a64db2f929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b1f13f0-a168-4d72-8272-f4b2a2e049ef', 'volume_name': 'volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdf11ba-50f8-4de4-bcdc-55994f79901a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdf11ba-50f8-4de4-bcdc-55994f79901a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1680d904-fffb-4d00-ac8d-ebcbb6f3e9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:02 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Volume 3b1f13f0-a168-4d72-8272-f4b2a2e049ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef', 'volume_size': 1} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1403043856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1f13f0-a168-4d72-8272-f4b2a2e049ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57789396bd1427baac658c7f086d46e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:13:02Z,use_quota=True,user_id='6ded3a874c3d432885c41027c1563c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Creating volume 3b1f13f0-a168-4d72-8272-f4b2a2e049ef {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:13:02 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:13:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:02 devstack sudo[91975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef 1073741824 Jun 02 16:13:02 devstack sudo[91975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:03 devstack sudo[91975]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef 1073741824" returned: 0 in 1.083s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:03 devstack sudo[91996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef Jun 02 16:13:03 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:04 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef" returned: 0 in 0.926s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:13:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.089s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1680d904-fffb-4d00-ac8d-ebcbb6f3e9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44ca90e-a993-413b-ba36-2f2f4684fd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:04 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Volume volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef (3b1f13f0-a168-4d72-8272-f4b2a2e049ef): created successfully Jun 02 16:13:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44ca90e-a993-413b-ba36-2f2f4684fd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Flow 'volume_create_manager' (28feef31-ea32-46df-ba39-5389b652d563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:13:04 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-fed5e9ed-3678-4ea9-8c14-ad8de609ad88 tempest-AttachVolumeNegativeTest-705416858 None] Created volume successfully. Jun 02 16:13:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-11423b34-a28e-49c8-981e-1a289893c3f5 req-fc01dc1c-2434-4b76-8dab-88e7e38ceb38 tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-11423b34-a28e-49c8-981e-1a289893c3f5 req-fc01dc1c-2434-4b76-8dab-88e7e38ceb38 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:08 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd17a96-5a61-4f46-a8df-323b9f8ea918]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:13:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-11423b34-a28e-49c8-981e-1a289893c3f5 req-fc01dc1c-2434-4b76-8dab-88e7e38ceb38 tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:08 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef Jun 02 16:13:08 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:09 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-11423b34-a28e-49c8-981e-1a289893c3f5 req-fc01dc1c-2434-4b76-8dab-88e7e38ceb38 tempest-AttachVolumeNegativeTest-705416858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef" returned: 0 in 1.049s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-11423b34-a28e-49c8-981e-1a289893c3f5 req-fc01dc1c-2434-4b76-8dab-88e7e38ceb38 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.071s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:09 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-11423b34-a28e-49c8-981e-1a289893c3f5 req-fc01dc1c-2434-4b76-8dab-88e7e38ceb38 tempest-AttachVolumeNegativeTest-705416858 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dbb87c49-efa5-45fe-88f8-240f75020145', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:13:09 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-11423b34-a28e-49c8-981e-1a289893c3f5 req-fc01dc1c-2434-4b76-8dab-88e7e38ceb38 tempest-AttachVolumeNegativeTest-705416858 None] attachment_update completed successfully. Jun 02 16:13:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "cinder-bb4489c0-2c0a-441d-8c05-bb7db0474233-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:13:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] Lock "cinder-bb4489c0-2c0a-441d-8c05-bb7db0474233-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:13:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "cinder-quobyte-bb4489c0-2c0a-441d-8c05-bb7db0474233" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:13:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] Lock "cinder-quobyte-bb4489c0-2c0a-441d-8c05-bb7db0474233" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:13:11 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af26942-505a-4cc5-9699-73e751ff4e69]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:13:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-bb4489c0-2c0a-441d-8c05-bb7db0474233 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:11 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-bb4489c0-2c0a-441d-8c05-bb7db0474233 Jun 02 16:13:11 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:12 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-bb4489c0-2c0a-441d-8c05-bb7db0474233" returned: 0 in 0.740s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-bb4489c0-2c0a-441d-8c05-bb7db0474233 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:12 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-bb4489c0-2c0a-441d-8c05-bb7db0474233 Jun 02 16:13:12 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:13 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-bb4489c0-2c0a-441d-8c05-bb7db0474233" returned: 0 in 0.660s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] Lock "cinder-quobyte-bb4489c0-2c0a-441d-8c05-bb7db0474233" released by "delete_volume" :: held 1.447s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:13:13 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] Created reservations ['09a99f1e-dabf-4a83-8d52-d30055ad5da7', '206a7821-87f1-41d1-afe9-9876b4f51a3e', '17b6aab5-e377-4bf9-930e-0cdb806b2113', 'b26de2d1-d607-497e-9568-15f1d2b90779'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:13:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:13:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:13:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:13 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:13:13 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "cinder-0c2eb839-2b5e-4225-a6f6-d3f95730cd89-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:13:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] Lock "cinder-0c2eb839-2b5e-4225-a6f6-d3f95730cd89-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:13:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "cinder-quobyte-0c2eb839-2b5e-4225-a6f6-d3f95730cd89" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:13:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] Lock "cinder-quobyte-0c2eb839-2b5e-4225-a6f6-d3f95730cd89" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:13:14 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe0356b-eaad-4193-816e-e10dedf6c873]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:13:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:14 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.902s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:14 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:13:14 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] Deleted volume successfully. Jun 02 16:13:14 devstack sudo[92547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89 Jun 02 16:13:14 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-44d62e4f-f551-4885-8417-10cb7dff9273 tempest-AttachVolumeTestJSON-1360013176 None] Lock "cinder-bb4489c0-2c0a-441d-8c05-bb7db0474233-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:13:15 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89" returned: 0 in 1.028s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:15 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89 Jun 02 16:13:15 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:16 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0c2eb839-2b5e-4225-a6f6-d3f95730cd89" returned: 0 in 0.962s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] Lock "cinder-quobyte-0c2eb839-2b5e-4225-a6f6-d3f95730cd89" released by "delete_volume" :: held 2.039s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:13:16 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] Created reservations ['b25f51e6-adf7-4b28-b0de-1eaaf7357351', '15315c2d-a1b3-46c3-9d2b-0efe303e9c04', 'fc053a32-eb17-4762-8144-7cda1afe74b9', 'f5dcad3a-c110-4fbb-8073-e0a14707271c'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:13:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:13:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:13:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:16 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:13:16 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:16 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.714s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:16 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:13:16 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] Deleted volume successfully. Jun 02 16:13:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c021dfd6-e8a5-444b-ab7c-ebd298e2201f tempest-AttachVolumeTestJSON-1360013176 None] Lock "cinder-0c2eb839-2b5e-4225-a6f6-d3f95730cd89-delete_volume" released by "delete_volume" :: held 3.026s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:13:17 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-df082509-02fd-442e-905b-8ea12f348a61 req-51b242f2-6792-42e1-914d-df36b15f675b tempest-AttachVolumeNegativeTest-705416858 None] Terminate volume connection completed successfully. Jun 02 16:13:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-df082509-02fd-442e-905b-8ea12f348a61 req-51b242f2-6792-42e1-914d-df36b15f675b tempest-AttachVolumeNegativeTest-705416858 None] Deleting attachment dbb87c49-efa5-45fe-88f8-240f75020145. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:13:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "cinder-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:13:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] Lock "cinder-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:13:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "cinder-quobyte-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:13:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] Lock "cinder-quobyte-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22" acquired by "delete_volume" :: waited 0.025s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:13:17 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10b2a8f-5a17-42fe-8ea6-decd832a1ca0]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:13:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:17 devstack sudo[92611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22 Jun 02 16:13:17 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:18 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22" returned: 0 in 0.792s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:18 devstack sudo[92616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22 Jun 02 16:13:18 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:18 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22" returned: 0 in 0.725s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] Lock "cinder-quobyte-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22" released by "delete_volume" :: held 1.563s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:13:19 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] Created reservations ['3b023963-e15e-470e-8796-9bad58eec215', 'e47e1d45-e743-43bf-bf94-0a2a8202af56', 'bdd02abc-ad01-4939-8150-c87f267cbead', '6bfd0202-7201-44e7-95a7-eaae99d50654'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:13:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:13:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:13:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:19 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:13:19 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:19 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.898s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:19 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:13:19 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] Deleted volume successfully. Jun 02 16:13:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ee298369-d8fd-4078-af28-a1e81f193b17 tempest-AttachVolumeTestJSON-1360013176 None] Lock "cinder-781356f7-4f3f-4a35-bc6e-d5c6bb4bad22-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:13:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-e8c2a6c2-d6ae-4f61-9516-2538a9b95155 req-28606547-d815-41ba-bb6e-74eba8a192f0 tempest-AttachVolumeShelveTestJSON-801041235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-e8c2a6c2-d6ae-4f61-9516-2538a9b95155 req-28606547-d815-41ba-bb6e-74eba8a192f0 tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:20 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc073a64-58d2-471d-98c0-87b5377e2e47]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:13:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-e8c2a6c2-d6ae-4f61-9516-2538a9b95155 req-28606547-d815-41ba-bb6e-74eba8a192f0 tempest-AttachVolumeShelveTestJSON-801041235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:20 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6 Jun 02 16:13:20 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:22 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-e8c2a6c2-d6ae-4f61-9516-2538a9b95155 req-28606547-d815-41ba-bb6e-74eba8a192f0 tempest-AttachVolumeShelveTestJSON-801041235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6" returned: 0 in 1.363s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-e8c2a6c2-d6ae-4f61-9516-2538a9b95155 req-28606547-d815-41ba-bb6e-74eba8a192f0 tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.384s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-e8c2a6c2-d6ae-4f61-9516-2538a9b95155 req-28606547-d815-41ba-bb6e-74eba8a192f0 tempest-AttachVolumeShelveTestJSON-801041235 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af6db794-d96f-4886-aac5-0e86117d33c3', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:13:22 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-e8c2a6c2-d6ae-4f61-9516-2538a9b95155 req-28606547-d815-41ba-bb6e-74eba8a192f0 tempest-AttachVolumeShelveTestJSON-801041235 None] attachment_update completed successfully. Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Flow 'volume_create_manager' (bf9a0f32-dd80-4756-9fc4-ca603193ac08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d5e06d-3089-4900-8979-2d19ba2fde1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d5e06d-3089-4900-8979-2d19ba2fde1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1341924716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d4a524fff7c4ff0ba84c5bdd7d9654e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:13:29Z,use_quota=True,user_id='78ee2127f4b94fbeb47a1ffd00474fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1251d4b2-0733-4ed4-9247-8c3cd3f2184b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1251d4b2-0733-4ed4-9247-8c3cd3f2184b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d156ed2d-f306-4f31-8975-fff165aa4765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d156ed2d-f306-4f31-8975-fff165aa4765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb', 'volume_name': 'volume-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2054658b-5728-4a66-a8c6-351f7efe1480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2054658b-5728-4a66-a8c6-351f7efe1480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f37dcb-2bc6-44e5-91f0-7a04db43961f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:29 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Volume 4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb', 'volume_size': 1} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1341924716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d4a524fff7c4ff0ba84c5bdd7d9654e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:13:29Z,use_quota=True,user_id='78ee2127f4b94fbeb47a1ffd00474fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Creating volume 4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:13:29 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:13:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:29 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb 1073741824 Jun 02 16:13:29 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:30 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb 1073741824" returned: 0 in 0.878s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:30 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:UPDATE=57,cinder:SELECT=59,cinder:DELETE=7,cinder:INSERT=13 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:13:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:30 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb Jun 02 16:13:30 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:30 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb" returned: 0 in 0.637s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:30 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:13:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f37dcb-2bc6-44e5-91f0-7a04db43961f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1668af3c-0d4f-4e33-a71f-22c695c5c568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:30 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Volume volume-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb (4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb): created successfully Jun 02 16:13:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1668af3c-0d4f-4e33-a71f-22c695c5c568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Flow 'volume_create_manager' (bf9a0f32-dd80-4756-9fc4-ca603193ac08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:13:30 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-bd5a4e29-8545-4f00-955c-fd7aad50bc20 req-31af5c34-5095-4cf4-aaa7-eb41893410dc tempest-VolumesGetTestJSON-2141649203 None] Created volume successfully. Jun 02 16:13:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] Acquiring lock "cinder-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:13:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] Lock "cinder-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:13:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] Acquiring lock "cinder-quobyte-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:13:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] Lock "cinder-quobyte-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb" acquired by "delete_volume" :: waited 0.030s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:13:32 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5def6edc-fe55-4e8a-8018-b030c4727d4e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:13:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:32 devstack sudo[92781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb Jun 02 16:13:32 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:33 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb" returned: 0 in 1.189s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:33 devstack sudo[92788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb Jun 02 16:13:33 devstack sudo[92788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:34 devstack sudo[92788]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb" returned: 0 in 0.757s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] Lock "cinder-quobyte-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb" released by "delete_volume" :: held 2.009s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:13:34 devstack cinder-volume[86488]: DEBUG cinder.quota [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] Created reservations ['b527a142-1a1f-426c-9643-a4030604f3a2', '1a45cdea-7a1c-42fa-80eb-bfbe904d0b40', 'f06624ed-0bda-43c5-bd3c-94927d80258b', 'a6f7de7e-c050-4574-9b28-1ef660018147'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:13:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:13:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:13:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:34 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:13:34 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:35 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.782s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:35 devstack cinder-volume[86488]: DEBUG cinder.manager [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:13:35 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] Deleted volume successfully. Jun 02 16:13:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-362eae08-cdb6-43a5-bb0d-280df208c90f req-dc153586-974b-4f7f-882d-3fecc75a3734 tempest-VolumesGetTestJSON-2141649203 None] Lock "cinder-4b0f1c7e-d5df-4f62-bf03-789e9e3f54fb-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Flow 'volume_create_manager' (0c70d32d-8f86-46b8-9854-0c2d3db3a3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb59ebbf-42e2-4691-a341-5086f1cbd455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb59ebbf-42e2-4691-a341-5086f1cbd455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-643683247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21015372-b92f-48a5-b13e-ab6a5dd60e2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bcd03b1319684f149622927f5185d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:13:39Z,use_quota=True,user_id='36138553d5a44ca2bbe3285a5e9b3d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a919fcd9-3bc2-49ca-8fc3-b075675f6814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a919fcd9-3bc2-49ca-8fc3-b075675f6814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4baad3fd-9e7f-4f2c-97e0-63459f5dd6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4baad3fd-9e7f-4f2c-97e0-63459f5dd6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21015372-b92f-48a5-b13e-ab6a5dd60e2d', 'volume_name': 'volume-21015372-b92f-48a5-b13e-ab6a5dd60e2d', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9172c3-2a7d-4051-a1cf-a9d9c6a3c0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9172c3-2a7d-4051-a1cf-a9d9c6a3c0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8208410-bfed-41a8-a205-e3027cbf98ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:38 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Volume 21015372-b92f-48a5-b13e-ab6a5dd60e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21015372-b92f-48a5-b13e-ab6a5dd60e2d', 'volume_size': 1} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-643683247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21015372-b92f-48a5-b13e-ab6a5dd60e2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bcd03b1319684f149622927f5185d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:13:39Z,use_quota=True,user_id='36138553d5a44ca2bbe3285a5e9b3d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Creating volume 21015372-b92f-48a5-b13e-ab6a5dd60e2d {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:13:38 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:13:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21015372-b92f-48a5-b13e-ab6a5dd60e2d 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:38 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21015372-b92f-48a5-b13e-ab6a5dd60e2d 1073741824 Jun 02 16:13:38 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:39 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21015372-b92f-48a5-b13e-ab6a5dd60e2d 1073741824" returned: 0 in 0.779s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21015372-b92f-48a5-b13e-ab6a5dd60e2d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:39 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21015372-b92f-48a5-b13e-ab6a5dd60e2d Jun 02 16:13:39 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:40 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21015372-b92f-48a5-b13e-ab6a5dd60e2d" returned: 0 in 0.612s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:13:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8208410-bfed-41a8-a205-e3027cbf98ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21015372-b92f-48a5-b13e-ab6a5dd60e2d', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca534580-3b13-4cde-b09c-755abda89e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:40 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Volume volume-21015372-b92f-48a5-b13e-ab6a5dd60e2d (21015372-b92f-48a5-b13e-ab6a5dd60e2d): created successfully Jun 02 16:13:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca534580-3b13-4cde-b09c-755abda89e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Flow 'volume_create_manager' (0c70d32d-8f86-46b8-9854-0c2d3db3a3f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:13:40 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-efa6d5eb-5604-477f-aa8f-9a8e1d56f7e4 tempest-VolumesTestJSON-2034171573 None] Created volume successfully. Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Flow 'volume_create_manager' (00799eaa-50d6-4add-8263-ad2c53cf92f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b6368d-f72d-4183-b074-1b985b6f9a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b6368d-f72d-4183-b074-1b985b6f9a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1304338352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965e1e1d-7e2e-498d-b764-6719dc848f0b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bcd03b1319684f149622927f5185d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:13:42Z,use_quota=True,user_id='36138553d5a44ca2bbe3285a5e9b3d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5c713f-4168-4518-b9d5-61fa7887b293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5c713f-4168-4518-b9d5-61fa7887b293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9028c46e-c063-4fde-88a5-851273dc53a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9028c46e-c063-4fde-88a5-851273dc53a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '965e1e1d-7e2e-498d-b764-6719dc848f0b', 'volume_name': 'volume-965e1e1d-7e2e-498d-b764-6719dc848f0b', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b67a643-ecec-4175-8bb4-94ac661c5f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b67a643-ecec-4175-8bb4-94ac661c5f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98ae2f7-19c1-4abc-aad9-f96dfe210720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:41 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Volume 965e1e1d-7e2e-498d-b764-6719dc848f0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-965e1e1d-7e2e-498d-b764-6719dc848f0b', 'volume_size': 1} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1304338352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965e1e1d-7e2e-498d-b764-6719dc848f0b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bcd03b1319684f149622927f5185d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:13:42Z,use_quota=True,user_id='36138553d5a44ca2bbe3285a5e9b3d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Creating volume 965e1e1d-7e2e-498d-b764-6719dc848f0b {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:13:41 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:13:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-965e1e1d-7e2e-498d-b764-6719dc848f0b 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:42 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-965e1e1d-7e2e-498d-b764-6719dc848f0b 1073741824 Jun 02 16:13:42 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:43 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-965e1e1d-7e2e-498d-b764-6719dc848f0b 1073741824" returned: 0 in 1.363s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-965e1e1d-7e2e-498d-b764-6719dc848f0b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:43 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-965e1e1d-7e2e-498d-b764-6719dc848f0b Jun 02 16:13:43 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:44 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-965e1e1d-7e2e-498d-b764-6719dc848f0b" returned: 0 in 1.112s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] <== create_volume: return (2521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:13:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.527s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98ae2f7-19c1-4abc-aad9-f96dfe210720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-965e1e1d-7e2e-498d-b764-6719dc848f0b', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d442d28-6349-43a3-92b7-dd7335bca32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:44 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Volume volume-965e1e1d-7e2e-498d-b764-6719dc848f0b (965e1e1d-7e2e-498d-b764-6719dc848f0b): created successfully Jun 02 16:13:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d442d28-6349-43a3-92b7-dd7335bca32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Flow 'volume_create_manager' (00799eaa-50d6-4add-8263-ad2c53cf92f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:13:44 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-756f7714-799d-408a-add8-fe2f6c2f83cf tempest-VolumesTestJSON-2034171573 None] Created volume successfully. Jun 02 16:13:45 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:13:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Flow 'volume_create_manager' (9eb8e168-7ed7-4655-b5cf-c7e709b7ae29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:13:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3399263-657d-416b-93c7-1d31bbdba1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3399263-657d-416b-93c7-1d31bbdba1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-27097199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9f9fce-55e1-4f29-9a53-13861b5f016b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bcd03b1319684f149622927f5185d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:13:46Z,use_quota=True,user_id='36138553d5a44ca2bbe3285a5e9b3d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134ec9c7-13f4-4780-9256-fab47248c548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134ec9c7-13f4-4780-9256-fab47248c548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c8d75c6-41d3-48b4-b8f8-1c585e5c05fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c8d75c6-41d3-48b4-b8f8-1c585e5c05fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af9f9fce-55e1-4f29-9a53-13861b5f016b', 'volume_name': 'volume-af9f9fce-55e1-4f29-9a53-13861b5f016b', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55de15be-8d2f-47fc-a903-dcf57b28036b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55de15be-8d2f-47fc-a903-dcf57b28036b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673e4584-aa51-4a7d-a6a7-9f3b00caa96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:46 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Volume af9f9fce-55e1-4f29-9a53-13861b5f016b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af9f9fce-55e1-4f29-9a53-13861b5f016b', 'volume_size': 1} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-27097199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9f9fce-55e1-4f29-9a53-13861b5f016b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bcd03b1319684f149622927f5185d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:13:46Z,use_quota=True,user_id='36138553d5a44ca2bbe3285a5e9b3d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Creating volume af9f9fce-55e1-4f29-9a53-13861b5f016b {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:13:46 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-af9f9fce-55e1-4f29-9a53-13861b5f016b 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:46 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-af9f9fce-55e1-4f29-9a53-13861b5f016b 1073741824 Jun 02 16:13:46 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:46 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-af9f9fce-55e1-4f29-9a53-13861b5f016b 1073741824" returned: 0 in 0.884s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-af9f9fce-55e1-4f29-9a53-13861b5f016b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:47 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-af9f9fce-55e1-4f29-9a53-13861b5f016b Jun 02 16:13:47 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:47 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-af9f9fce-55e1-4f29-9a53-13861b5f016b" returned: 0 in 0.817s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:47 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:13:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673e4584-aa51-4a7d-a6a7-9f3b00caa96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af9f9fce-55e1-4f29-9a53-13861b5f016b', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ed5adc-eae0-4573-855d-f8a69bfc07fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:47 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Volume volume-af9f9fce-55e1-4f29-9a53-13861b5f016b (af9f9fce-55e1-4f29-9a53-13861b5f016b): created successfully Jun 02 16:13:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ed5adc-eae0-4573-855d-f8a69bfc07fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Flow 'volume_create_manager' (9eb8e168-7ed7-4655-b5cf-c7e709b7ae29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:13:47 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0d091db8-0856-41b0-aee9-2f00697a6803 tempest-VolumesTestJSON-2034171573 None] Created volume successfully. Jun 02 16:13:47 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:13:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Flow 'volume_create_manager' (d6e00d66-22bd-4e2e-9fc1-63d26bbf3663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:13:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c422b6b-9565-4946-b498-f12fa1531657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c422b6b-9565-4946-b498-f12fa1531657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1657415237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265baad1-5897-4717-8211-1410a053174f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b46aa06a19c4a3e8b47c5246293b85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:13:48Z,use_quota=True,user_id='27b791ac1e9f4b068460f8f1991f3faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9db3c4-0557-4e07-b9cc-f9db0c4d3321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9db3c4-0557-4e07-b9cc-f9db0c4d3321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ac5894-2de6-426c-8494-0db2a12754c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ac5894-2de6-426c-8494-0db2a12754c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '265baad1-5897-4717-8211-1410a053174f', 'volume_name': 'volume-265baad1-5897-4717-8211-1410a053174f', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5fcdf81-2d3d-4c5f-82d7-3d16a5a9ccf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5fcdf81-2d3d-4c5f-82d7-3d16a5a9ccf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a715b1-1ca2-4af9-a0f2-edb0593069a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:48 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Volume 265baad1-5897-4717-8211-1410a053174f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-265baad1-5897-4717-8211-1410a053174f', 'volume_size': 1} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1657415237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265baad1-5897-4717-8211-1410a053174f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b46aa06a19c4a3e8b47c5246293b85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:13:48Z,use_quota=True,user_id='27b791ac1e9f4b068460f8f1991f3faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Creating volume 265baad1-5897-4717-8211-1410a053174f {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:13:48 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:13:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:48 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f 1073741824 Jun 02 16:13:48 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:49 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f 1073741824" returned: 0 in 1.486s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:49 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f Jun 02 16:13:49 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:51 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f" returned: 0 in 1.420s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] <== create_volume: return (3036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:13:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.044s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a715b1-1ca2-4af9-a0f2-edb0593069a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-265baad1-5897-4717-8211-1410a053174f', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea916e0-73dc-47d6-be83-65bb41a2a12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:13:51 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Volume volume-265baad1-5897-4717-8211-1410a053174f (265baad1-5897-4717-8211-1410a053174f): created successfully Jun 02 16:13:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea916e0-73dc-47d6-be83-65bb41a2a12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:13:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Flow 'volume_create_manager' (d6e00d66-22bd-4e2e-9fc1-63d26bbf3663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:13:51 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-39d811ab-9e61-4981-a208-c72723f5d613 tempest-ServerActionsTestOtherA-1811101398 None] Created volume successfully. Jun 02 16:13:51 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] Acquiring lock "cinder-af9f9fce-55e1-4f29-9a53-13861b5f016b-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:13:51 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] Lock "cinder-af9f9fce-55e1-4f29-9a53-13861b5f016b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:13:51 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] Acquiring lock "cinder-quobyte-af9f9fce-55e1-4f29-9a53-13861b5f016b" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:13:51 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] Lock "cinder-quobyte-af9f9fce-55e1-4f29-9a53-13861b5f016b" acquired by "delete_volume" :: waited 0.033s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:13:51 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c56122-0a7e-4b0e-8b97-c98898fb631e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:13:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-af9f9fce-55e1-4f29-9a53-13861b5f016b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:51 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-af9f9fce-55e1-4f29-9a53-13861b5f016b Jun 02 16:13:51 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:53 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-af9f9fce-55e1-4f29-9a53-13861b5f016b" returned: 0 in 1.387s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-af9f9fce-55e1-4f29-9a53-13861b5f016b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:53 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-af9f9fce-55e1-4f29-9a53-13861b5f016b Jun 02 16:13:53 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:54 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-af9f9fce-55e1-4f29-9a53-13861b5f016b" returned: 0 in 1.155s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:54 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] Lock "cinder-quobyte-af9f9fce-55e1-4f29-9a53-13861b5f016b" released by "delete_volume" :: held 2.611s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:13:54 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] Created reservations ['ba89bdde-1942-4f2b-b6ed-af92776b7bba', 'e133a464-5fef-4f5c-b821-ef77fa3153b7', '3f366b3d-bc33-4833-a6ae-9b108606bdb4', '58c839e6-b30b-42a7-9b13-dc590b9761fd'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:13:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:54 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:13:54 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:13:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:54 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:13:54 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:55 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] Acquiring lock "cinder-965e1e1d-7e2e-498d-b764-6719dc848f0b-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:13:55 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] Lock "cinder-965e1e1d-7e2e-498d-b764-6719dc848f0b-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:13:55 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] Acquiring lock "cinder-quobyte-965e1e1d-7e2e-498d-b764-6719dc848f0b" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:13:55 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] Lock "cinder-quobyte-965e1e1d-7e2e-498d-b764-6719dc848f0b" acquired by "delete_volume" :: waited 0.034s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:13:55 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de50ad1-aa6d-4f4f-ac0a-0626c6f57689]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:13:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-965e1e1d-7e2e-498d-b764-6719dc848f0b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:55 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-965e1e1d-7e2e-498d-b764-6719dc848f0b Jun 02 16:13:55 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:55 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.269s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:55 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:13:55 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] Deleted volume successfully. Jun 02 16:13:55 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-18814866-7e4a-49ff-a85d-3a47470f7a14 tempest-VolumesTestJSON-2034171573 None] Lock "cinder-af9f9fce-55e1-4f29-9a53-13861b5f016b-delete_volume" released by "delete_volume" :: held 4.312s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:13:56 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-965e1e1d-7e2e-498d-b764-6719dc848f0b" returned: 0 in 1.417s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-965e1e1d-7e2e-498d-b764-6719dc848f0b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:56 devstack sudo[93451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-965e1e1d-7e2e-498d-b764-6719dc848f0b Jun 02 16:13:56 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:57 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-965e1e1d-7e2e-498d-b764-6719dc848f0b" returned: 0 in 0.899s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:57 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] Lock "cinder-quobyte-965e1e1d-7e2e-498d-b764-6719dc848f0b" released by "delete_volume" :: held 2.385s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:13:57 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] Created reservations ['4eb5c8d8-5070-47d3-a59e-834abb52aa4e', '98db4e53-f784-40fa-ba26-46e321582ab1', 'd54ea030-fadc-4756-a84e-b33b02de5e37', 'fc8511be-0b1d-4dbe-8935-aa3b84b8df28'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:13:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:13:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:13:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:13:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:13:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:13:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:57 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:13:57 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:58 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.596s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:58 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:13:58 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] Deleted volume successfully. Jun 02 16:13:58 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e26d1061-9a32-42ca-a542-664e10714c77 tempest-VolumesTestJSON-2034171573 None] Lock "cinder-965e1e1d-7e2e-498d-b764-6719dc848f0b-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:13:58 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] Acquiring lock "cinder-21015372-b92f-48a5-b13e-ab6a5dd60e2d-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:13:58 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] Lock "cinder-21015372-b92f-48a5-b13e-ab6a5dd60e2d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:13:58 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=55,cinder:UPDATE=68,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:13:58 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] Acquiring lock "cinder-quobyte-21015372-b92f-48a5-b13e-ab6a5dd60e2d" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:13:58 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] Lock "cinder-quobyte-21015372-b92f-48a5-b13e-ab6a5dd60e2d" acquired by "delete_volume" :: waited 0.025s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:13:58 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5b3068-4ae4-4ed9-9906-09b955428954]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:13:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21015372-b92f-48a5-b13e-ab6a5dd60e2d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:59 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21015372-b92f-48a5-b13e-ab6a5dd60e2d Jun 02 16:13:59 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:13:59 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Jun 02 16:13:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21015372-b92f-48a5-b13e-ab6a5dd60e2d" returned: 0 in 0.895s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:13:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21015372-b92f-48a5-b13e-ab6a5dd60e2d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:13:59 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21015372-b92f-48a5-b13e-ab6a5dd60e2d Jun 02 16:13:59 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:14:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:14:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:14:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:00 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:14:00 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:00 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21015372-b92f-48a5-b13e-ab6a5dd60e2d" returned: 0 in 0.804s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:00 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] Lock "cinder-quobyte-21015372-b92f-48a5-b13e-ab6a5dd60e2d" released by "delete_volume" :: held 1.776s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:14:00 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] Created reservations ['9c67f625-54e8-44b4-a1ec-ec94c861913d', 'bec422cb-76b2-4399-a2df-a6ff8d69409f', 'daa9e3eb-2ca8-4d48-81c2-1eeab3938895', '92fdbe6f-e385-4f9a-ac5b-204cad9f33a2'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:14:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:14:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:14:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:01 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:14:01 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:01 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.346s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:01 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:14:02 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.005s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:02 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:14:02 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] Deleted volume successfully. Jun 02 16:14:02 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c09884e7-7467-4b46-984d-49280d36e984 tempest-VolumesTestJSON-2034171573 None] Lock "cinder-21015372-b92f-48a5-b13e-ab6a5dd60e2d-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:14:05 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-14e70d84-3f0f-402b-acff-081365211f9f tempest-GroupSnapshotsV319Test-1822202873 None] Group tempest-GroupSnapshotsV319Test-Group-1360188405: creating Jun 02 16:14:05 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-14e70d84-3f0f-402b-acff-081365211f9f tempest-GroupSnapshotsV319Test-1822202873 None] Group tempest-GroupSnapshotsV319Test-Group-1360188405: created successfully Jun 02 16:14:05 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-14e70d84-3f0f-402b-acff-081365211f9f tempest-GroupSnapshotsV319Test-1822202873 None] Create group completed successfully. Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Flow 'volume_create_manager' (71f6d20d-ac3d-4b34-87a8-82db0d2543e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1b0896-2860-4e1b-97c4-0e00177d2840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1b0896-2860-4e1b-97c4-0e00177d2840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-941946497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f055aab-9180-480b-8ace-6d5a343ece6f,host='devstack@QuobyteHD#QuobyteHD',id=3857afe8-7835-4f47-a098-69d278ef71bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f159bd12264d73ac0a4cf76909f8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:14:08Z,use_quota=True,user_id='3f9363ed5a974056873dbf0d96ecb6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(078259f2-2847-4eab-8ab3-0b637a9e4c0c),volume_type_id=078259f2-2847-4eab-8ab3-0b637a9e4c0c)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27abbfb9-b882-47a7-b53b-13e32f663f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27abbfb9-b882-47a7-b53b-13e32f663f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5fcb60-0bc7-4437-b0cc-ab802d4dfa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5fcb60-0bc7-4437-b0cc-ab802d4dfa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3857afe8-7835-4f47-a098-69d278ef71bf', 'volume_name': 'volume-3857afe8-7835-4f47-a098-69d278ef71bf', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528868e3-dc63-45f2-b49d-29f0e31518b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528868e3-dc63-45f2-b49d-29f0e31518b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af026b9e-87c8-4613-a9c9-67dc23e3402d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:07 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Volume 3857afe8-7835-4f47-a098-69d278ef71bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3857afe8-7835-4f47-a098-69d278ef71bf', 'volume_size': 1} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4f055aab-9180-480b-8ace-6d5a343ece6f,created_at=2026-06-02T14:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-941946497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f055aab-9180-480b-8ace-6d5a343ece6f,host='devstack@QuobyteHD#QuobyteHD',id=3857afe8-7835-4f47-a098-69d278ef71bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f159bd12264d73ac0a4cf76909f8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:14:08Z,use_quota=True,user_id='3f9363ed5a974056873dbf0d96ecb6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(078259f2-2847-4eab-8ab3-0b637a9e4c0c),volume_type_id=078259f2-2847-4eab-8ab3-0b637a9e4c0c)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Creating volume 3857afe8-7835-4f47-a098-69d278ef71bf {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:14:07 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:14:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:07 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf 1073741824 Jun 02 16:14:07 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:08 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf 1073741824" returned: 0 in 0.836s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:08 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf Jun 02 16:14:08 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:09 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf" returned: 0 in 0.612s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:14:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:09 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af026b9e-87c8-4613-a9c9-67dc23e3402d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3857afe8-7835-4f47-a098-69d278ef71bf', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:09 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9895d436-1d07-4d7e-a8ec-21e318219df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:09 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Volume volume-3857afe8-7835-4f47-a098-69d278ef71bf (3857afe8-7835-4f47-a098-69d278ef71bf): created successfully Jun 02 16:14:09 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9895d436-1d07-4d7e-a8ec-21e318219df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:09 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Flow 'volume_create_manager' (71f6d20d-ac3d-4b34-87a8-82db0d2543e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:14:09 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-fde64a18-8a61-43da-bd15-bde311686122 tempest-GroupSnapshotsV319Test-1822202873 None] Created volume successfully. Jun 02 16:14:10 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] GroupSnapshot 0723690d-227e-48bd-8821-74dc330c2009: creating. Jun 02 16:14:10 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] Group snapshot 0723690d-227e-48bd-8821-74dc330c2009: creating. {{(pid=86488) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 02 16:14:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] Creating offline snapshot e828f943-a5ff-424c-ba31-4f0ee118383b of volume 3857afe8-7835-4f47-a098-69d278ef71bf {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:14:10 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dceb8d-0546-4ac3-8129-eeaa934a0401]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:14:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:10 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf Jun 02 16:14:10 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:11 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf" returned: 0 in 0.827s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:11 devstack sudo[93647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b 1G Jun 02 16:14:11 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:11 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b 1G" returned: 0 in 0.812s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3857afe8-7835-4f47-a098-69d278ef71bf -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:11 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3857afe8-7835-4f47-a098-69d278ef71bf -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b Jun 02 16:14:11 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:12 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3857afe8-7835-4f47-a098-69d278ef71bf -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b" returned: 0 in 0.642s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:12 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b is being set with open permissions: ugo+rw: NotImplementedError Jun 02 16:14:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:12 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b Jun 02 16:14:12 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:13 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b" returned: 0 in 0.575s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:13 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.info Jun 02 16:14:13 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:13 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.info" returned: 0 in 0.662s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:13 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 16:14:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:13 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.info Jun 02 16:14:13 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:14 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.info" returned: 0 in 0.612s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.231s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:14 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0ebc9616-cc2a-4105-8dd4-3a9f4fe04d2e tempest-GroupSnapshotsV319Test-1822202873 None] group_snapshot 0723690d-227e-48bd-8821-74dc330c2009: created successfully Jun 02 16:14:16 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] group_snapshot 0723690d-227e-48bd-8821-74dc330c2009: deleting Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] group_snapshot 0723690d-227e-48bd-8821-74dc330c2009: deleting {{(pid=86488) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] Acquiring lock "cinder-quobyte-3857afe8-7835-4f47-a098-69d278ef71bf" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] Lock "cinder-quobyte-3857afe8-7835-4f47-a098-69d278ef71bf" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] Acquiring lock "cinder-quobyte-e828f943-a5ff-424c-ba31-4f0ee118383b" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] Lock "cinder-quobyte-e828f943-a5ff-424c-ba31-4f0ee118383b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] Deleting offline snapshot e828f943-a5ff-424c-ba31-4f0ee118383b of volume 3857afe8-7835-4f47-a098-69d278ef71bf {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] snapshot_file for this snap is: volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[835432a1-ca3b-4f13-a4fb-df8f5a9a0b68]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:16 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b Jun 02 16:14:16 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Flow 'volume_create_manager' (22067f01-ff44-42c5-9ad8-e6329f01a420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22c803a-eb19-4664-bda3-181c3f6c9a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22c803a-eb19-4664-bda3-181c3f6c9a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1411538058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8615b0-49a6-4ded-b765-288f8b549899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57789396bd1427baac658c7f086d46e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:14:17Z,use_quota=True,user_id='6ded3a874c3d432885c41027c1563c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004c33d4-9be0-42e9-8d68-ef9b9b8a65a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004c33d4-9be0-42e9-8d68-ef9b9b8a65a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9bc8cd-066e-4ce1-be66-8bf1326ac7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9bc8cd-066e-4ce1-be66-8bf1326ac7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba8615b0-49a6-4ded-b765-288f8b549899', 'volume_name': 'volume-ba8615b0-49a6-4ded-b765-288f8b549899', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e237c138-3818-4ebe-a289-aa975b8fbda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e237c138-3818-4ebe-a289-aa975b8fbda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346b4ffe-719d-4bd9-bfbf-d48a429076e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:16 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Volume ba8615b0-49a6-4ded-b765-288f8b549899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba8615b0-49a6-4ded-b765-288f8b549899', 'volume_size': 1} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1411538058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8615b0-49a6-4ded-b765-288f8b549899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57789396bd1427baac658c7f086d46e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:14:17Z,use_quota=True,user_id='6ded3a874c3d432885c41027c1563c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Creating volume ba8615b0-49a6-4ded-b765-288f8b549899 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:14:16 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ba8615b0-49a6-4ded-b765-288f8b549899 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:16 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ba8615b0-49a6-4ded-b765-288f8b549899 1073741824 Jun 02 16:14:16 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:16 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b" returned: 0 in 0.807s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3857afe8-7835-4f47-a098-69d278ef71bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:14:17 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[57579af0-8bb4-4719-8db0-dfbe5eea0f6b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:14:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:17 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf Jun 02 16:14:17 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:17 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ba8615b0-49a6-4ded-b765-288f8b549899 1073741824" returned: 0 in 0.856s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ba8615b0-49a6-4ded-b765-288f8b549899 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:17 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ba8615b0-49a6-4ded-b765-288f8b549899 Jun 02 16:14:17 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:17 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf" returned: 0 in 0.855s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:17 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b Jun 02 16:14:17 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:18 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ba8615b0-49a6-4ded-b765-288f8b549899" returned: 0 in 0.641s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:14:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346b4ffe-719d-4bd9-bfbf-d48a429076e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8615b0-49a6-4ded-b765-288f8b549899', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421bf026-b06c-4c02-a156-a3f8a98e237d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:18 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Volume volume-ba8615b0-49a6-4ded-b765-288f8b549899 (ba8615b0-49a6-4ded-b765-288f8b549899): created successfully Jun 02 16:14:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421bf026-b06c-4c02-a156-a3f8a98e237d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Flow 'volume_create_manager' (22067f01-ff44-42c5-9ad8-e6329f01a420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:14:18 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-519833d7-16de-44c0-beac-96b396045371 tempest-AttachVolumeNegativeTest-705416858 None] Created volume successfully. Jun 02 16:14:18 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b" returned: 0 in 0.734s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:18 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b Jun 02 16:14:18 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:19 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf.e828f943-a5ff-424c-ba31-4f0ee118383b" returned: 0 in 0.707s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] Lock "cinder-quobyte-e828f943-a5ff-424c-ba31-4f0ee118383b" released by "_delete_snapshot" :: held 3.232s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:14:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] Lock "cinder-quobyte-3857afe8-7835-4f47-a098-69d278ef71bf" released by "delete_snapshot" :: held 3.259s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:14:19 devstack cinder-volume[86488]: WARNING cinder.quota [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2088191081 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2088191081, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:14:19 devstack cinder-volume[86488]: WARNING cinder.quota [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2088191081 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2088191081, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:14:19 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] Created reservations ['8dd2b1fd-ca04-4783-be60-7e9de37eb264', '900ef128-5388-4fe0-b727-1725a3c33ae4', '294a7959-ede5-48f1-b8a6-0a24e90bdb6c', '75a7bb9e-e19c-4c11-b06e-23c3fa46e33c'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:14:19 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-7117bfd5-99b6-4f38-b11e-28806d39ae84 tempest-GroupSnapshotsV319Test-1822202873 None] group_snapshot 0723690d-227e-48bd-8821-74dc330c2009: deleted successfully Jun 02 16:14:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] Acquiring lock "cinder-quobyte-3857afe8-7835-4f47-a098-69d278ef71bf" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:14:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] Lock "cinder-quobyte-3857afe8-7835-4f47-a098-69d278ef71bf" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:14:20 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83c1a40-7374-4fa4-86e3-7650c24600a2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:14:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:20 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf Jun 02 16:14:20 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:21 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf" returned: 0 in 0.771s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:21 devstack sudo[93762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf Jun 02 16:14:21 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-9779529c-8ba3-4e96-9aa2-59639b949679 req-b6298e74-170c-45de-be59-7f507a4c0d42 tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-9779529c-8ba3-4e96-9aa2-59639b949679 req-b6298e74-170c-45de-be59-7f507a4c0d42 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd50fd2-2ed8-443d-8c73-d9d23a738e64]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-9779529c-8ba3-4e96-9aa2-59639b949679 req-b6298e74-170c-45de-be59-7f507a4c0d42 tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ba8615b0-49a6-4ded-b765-288f8b549899 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:22 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-57205e1c-df22-40e3-afca-f26205c3c676 req-6b30dc26-a80a-46be-b253-65209efd5b41 tempest-AttachVolumeShelveTestJSON-801041235 None] Terminate volume connection completed successfully. Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-57205e1c-df22-40e3-afca-f26205c3c676 req-6b30dc26-a80a-46be-b253-65209efd5b41 tempest-AttachVolumeShelveTestJSON-801041235 None] Deleting attachment af6db794-d96f-4886-aac5-0e86117d33c3. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:14:22 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3857afe8-7835-4f47-a098-69d278ef71bf" returned: 0 in 0.630s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:22 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ba8615b0-49a6-4ded-b765-288f8b549899 Jun 02 16:14:22 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] Lock "cinder-quobyte-3857afe8-7835-4f47-a098-69d278ef71bf" released by "delete_volume" :: held 1.478s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] Created reservations ['0fe2a99c-1e55-42c5-95a7-afb9bd00a17d'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:14:22 devstack cinder-volume[86488]: WARNING cinder.quota [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2088191081 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2088191081, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] Created reservations ['2f445272-fd2c-47fe-9c3c-88c680f5fc1b', '42673bb8-b4af-4e32-8efa-4228267b43c9', '45e3cd41-fab8-415f-b64c-3a07a7eb1295', '5b409ba0-3e11-4e2a-a191-3d503f228612'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:22 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:14:22 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:22 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-9779529c-8ba3-4e96-9aa2-59639b949679 req-b6298e74-170c-45de-be59-7f507a4c0d42 tempest-AttachVolumeNegativeTest-705416858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ba8615b0-49a6-4ded-b765-288f8b549899" returned: 0 in 0.795s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-9779529c-8ba3-4e96-9aa2-59639b949679 req-b6298e74-170c-45de-be59-7f507a4c0d42 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.824s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-9779529c-8ba3-4e96-9aa2-59639b949679 req-b6298e74-170c-45de-be59-7f507a4c0d42 tempest-AttachVolumeNegativeTest-705416858 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-ba8615b0-49a6-4ded-b765-288f8b549899', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '644c96c3-a69b-4d05-9951-ff49877f0b90', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:14:23 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-9779529c-8ba3-4e96-9aa2-59639b949679 req-b6298e74-170c-45de-be59-7f507a4c0d42 tempest-AttachVolumeNegativeTest-705416858 None] attachment_update completed successfully. Jun 02 16:14:23 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.736s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:23 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:14:23 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-a8b75cbf-dbbf-44d5-a2cc-88cc997b9a32 tempest-GroupSnapshotsV319Test-1822202873 None] Delete group completed successfully. Jun 02 16:14:29 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-2f10772e-8144-4432-bd5c-edc995b971e0 req-2a36c911-b2c4-4a9e-9307-89766d923378 tempest-AttachVolumeNegativeTest-705416858 None] Terminate volume connection completed successfully. Jun 02 16:14:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-2f10772e-8144-4432-bd5c-edc995b971e0 req-2a36c911-b2c4-4a9e-9307-89766d923378 tempest-AttachVolumeNegativeTest-705416858 None] Deleting attachment 644c96c3-a69b-4d05-9951-ff49877f0b90. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:14:29 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-97e5b028-a97c-4297-aefd-09fd9b17c11c tempest-GroupsTest-158943942 None] Group tempest-Group1-1266585593: creating Jun 02 16:14:29 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-97e5b028-a97c-4297-aefd-09fd9b17c11c tempest-GroupsTest-158943942 None] Group tempest-Group1-1266585593: created successfully Jun 02 16:14:29 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-97e5b028-a97c-4297-aefd-09fd9b17c11c tempest-GroupsTest-158943942 None] Create group completed successfully. Jun 02 16:14:30 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:UPDATE=71,cinder:DELETE=5,cinder:SELECT=70,cinder:INSERT=17 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:14:30 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9b8eb5b3-00c6-421f-9208-ae3e2e164171 tempest-GroupsTest-158943942 None] Group tempest-Group2-451160983: creating Jun 02 16:14:30 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9b8eb5b3-00c6-421f-9208-ae3e2e164171 tempest-GroupsTest-158943942 None] Group tempest-Group2-451160983: created successfully Jun 02 16:14:30 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9b8eb5b3-00c6-421f-9208-ae3e2e164171 tempest-GroupsTest-158943942 None] Create group completed successfully. Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Flow 'volume_create_manager' (5ec28c1f-4317-4191-9d5d-f7c79a936132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6edc5e9b-d6fd-47b6-b72d-16fdd2fd6a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6edc5e9b-d6fd-47b6-b72d-16fdd2fd6a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-826857440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e42af9f6-700b-42a8-9699-b8bfed546ae8,host='devstack@QuobyteHD#QuobyteHD',id=d989e3a1-2c27-4416-ae69-eef703ece167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696cbae9e7034454adb0f9c59e151ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:14:32Z,use_quota=True,user_id='7b4b6d2d5c394179aba04692e7c2b514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f47c7c7b-ca72-4448-a6af-9326b0a2eea5),volume_type_id=f47c7c7b-ca72-4448-a6af-9326b0a2eea5)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477c5fc0-cf5c-43c8-a495-a1fe08d45fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477c5fc0-cf5c-43c8-a495-a1fe08d45fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27041a54-4d01-4474-81ed-8a10408de79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27041a54-4d01-4474-81ed-8a10408de79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd989e3a1-2c27-4416-ae69-eef703ece167', 'volume_name': 'volume-d989e3a1-2c27-4416-ae69-eef703ece167', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30022bbd-0dff-4008-b844-9fce98eb366f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30022bbd-0dff-4008-b844-9fce98eb366f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67eb033a-79e7-4c60-9e94-933f71c5f4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:32 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Volume d989e3a1-2c27-4416-ae69-eef703ece167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d989e3a1-2c27-4416-ae69-eef703ece167', 'volume_size': 1} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e42af9f6-700b-42a8-9699-b8bfed546ae8,created_at=2026-06-02T14:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-826857440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e42af9f6-700b-42a8-9699-b8bfed546ae8,host='devstack@QuobyteHD#QuobyteHD',id=d989e3a1-2c27-4416-ae69-eef703ece167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696cbae9e7034454adb0f9c59e151ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:14:32Z,use_quota=True,user_id='7b4b6d2d5c394179aba04692e7c2b514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f47c7c7b-ca72-4448-a6af-9326b0a2eea5),volume_type_id=f47c7c7b-ca72-4448-a6af-9326b0a2eea5)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Creating volume d989e3a1-2c27-4416-ae69-eef703ece167 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:14:32 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:14:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d989e3a1-2c27-4416-ae69-eef703ece167 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:32 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d989e3a1-2c27-4416-ae69-eef703ece167 1073741824 Jun 02 16:14:32 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:33 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d989e3a1-2c27-4416-ae69-eef703ece167 1073741824" returned: 0 in 1.362s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d989e3a1-2c27-4416-ae69-eef703ece167 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:33 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d989e3a1-2c27-4416-ae69-eef703ece167 Jun 02 16:14:33 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:34 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d989e3a1-2c27-4416-ae69-eef703ece167" returned: 0 in 0.677s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:14:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.109s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67eb033a-79e7-4c60-9e94-933f71c5f4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d989e3a1-2c27-4416-ae69-eef703ece167', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ec32ee-0216-4cf9-bd43-511cb4d98dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:34 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Volume volume-d989e3a1-2c27-4416-ae69-eef703ece167 (d989e3a1-2c27-4416-ae69-eef703ece167): created successfully Jun 02 16:14:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ec32ee-0216-4cf9-bd43-511cb4d98dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Flow 'volume_create_manager' (5ec28c1f-4317-4191-9d5d-f7c79a936132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:14:34 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-8090a65f-be3f-4439-9cc3-218fddb8408d tempest-GroupsTest-158943942 None] Created volume successfully. Jun 02 16:14:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] Acquiring lock "cinder-quobyte-d989e3a1-2c27-4416-ae69-eef703ece167" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:14:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] Lock "cinder-quobyte-d989e3a1-2c27-4416-ae69-eef703ece167" acquired by "delete_volume" :: waited 0.017s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:14:36 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d114414a-d5b8-4af2-8fcc-06018ef9d30b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:14:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d989e3a1-2c27-4416-ae69-eef703ece167 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:36 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d989e3a1-2c27-4416-ae69-eef703ece167 Jun 02 16:14:36 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-070cb57f-1b15-487f-8634-b8904fffeb26 req-3bdcfb49-f75d-4fe8-be1b-098f8c36cd9f tempest-ServerActionsTestOtherA-1811101398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-070cb57f-1b15-487f-8634-b8904fffeb26 req-3bdcfb49-f75d-4fe8-be1b-098f8c36cd9f tempest-ServerActionsTestOtherA-1811101398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:36 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a118d309-555f-4f97-ad9f-6bd725c15e5e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:14:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-070cb57f-1b15-487f-8634-b8904fffeb26 req-3bdcfb49-f75d-4fe8-be1b-098f8c36cd9f tempest-ServerActionsTestOtherA-1811101398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:37 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f Jun 02 16:14:37 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:37 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d989e3a1-2c27-4416-ae69-eef703ece167" returned: 0 in 0.839s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d989e3a1-2c27-4416-ae69-eef703ece167 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:37 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d989e3a1-2c27-4416-ae69-eef703ece167 Jun 02 16:14:37 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:37 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-070cb57f-1b15-487f-8634-b8904fffeb26 req-3bdcfb49-f75d-4fe8-be1b-098f8c36cd9f tempest-ServerActionsTestOtherA-1811101398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f" returned: 0 in 0.882s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-070cb57f-1b15-487f-8634-b8904fffeb26 req-3bdcfb49-f75d-4fe8-be1b-098f8c36cd9f tempest-ServerActionsTestOtherA-1811101398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.913s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-070cb57f-1b15-487f-8634-b8904fffeb26 req-3bdcfb49-f75d-4fe8-be1b-098f8c36cd9f tempest-ServerActionsTestOtherA-1811101398 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-265baad1-5897-4717-8211-1410a053174f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80210ea0-2c3b-436e-a99c-c0b89df01581', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:14:37 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d989e3a1-2c27-4416-ae69-eef703ece167" returned: 0 in 0.716s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] Lock "cinder-quobyte-d989e3a1-2c27-4416-ae69-eef703ece167" released by "delete_volume" :: held 1.621s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:14:37 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-070cb57f-1b15-487f-8634-b8904fffeb26 req-3bdcfb49-f75d-4fe8-be1b-098f8c36cd9f tempest-ServerActionsTestOtherA-1811101398 None] attachment_update completed successfully. Jun 02 16:14:37 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] Created reservations ['370ce9d9-ec44-4891-8698-e457738f83eb'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:14:37 devstack cinder-volume[86488]: WARNING cinder.quota [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-469411441 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-469411441, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:14:37 devstack cinder-volume[86488]: WARNING cinder.quota [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-469411441 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-469411441, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:14:38 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] Created reservations ['56857c41-f725-4f88-ab6d-1a104b7f2fa3', '58b34b1c-f43e-40d3-ae8c-beb62def31e3', '3222e45c-c461-4c96-8c83-711c2163abaa', '62b108c4-97f1-4531-8317-95ec2feb7b53'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:14:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:14:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:14:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:38 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:14:38 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:38 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-08cfe9ce-6939-489c-b20b-301e62567db3 tempest-GroupsTest-158943942 None] Created reservations ['34807b71-8f0d-446c-a099-7fc53c96f915'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:14:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08cfe9ce-6939-489c-b20b-301e62567db3 tempest-GroupsTest-158943942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08cfe9ce-6939-489c-b20b-301e62567db3 tempest-GroupsTest-158943942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-08cfe9ce-6939-489c-b20b-301e62567db3 tempest-GroupsTest-158943942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:14:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-08cfe9ce-6939-489c-b20b-301e62567db3 tempest-GroupsTest-158943942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:14:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08cfe9ce-6939-489c-b20b-301e62567db3 tempest-GroupsTest-158943942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-08cfe9ce-6939-489c-b20b-301e62567db3 tempest-GroupsTest-158943942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:38 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.742s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:38 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:14:38 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:14:38 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-58d54303-1b8b-4dd1-ba2f-1f8000aa012a tempest-GroupsTest-158943942 None] Delete group completed successfully. Jun 02 16:14:38 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "cinder-ba8615b0-49a6-4ded-b765-288f8b549899-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:14:39 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-08cfe9ce-6939-489c-b20b-301e62567db3 tempest-GroupsTest-158943942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.690s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:39 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-08cfe9ce-6939-489c-b20b-301e62567db3 tempest-GroupsTest-158943942 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:14:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] Lock "cinder-ba8615b0-49a6-4ded-b765-288f8b549899-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:14:39 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-08cfe9ce-6939-489c-b20b-301e62567db3 tempest-GroupsTest-158943942 None] Delete group completed successfully. Jun 02 16:14:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "cinder-quobyte-ba8615b0-49a6-4ded-b765-288f8b549899" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:14:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] Lock "cinder-quobyte-ba8615b0-49a6-4ded-b765-288f8b549899" acquired by "delete_volume" :: waited 0.017s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:14:39 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf60b46-f61d-4e59-9544-35d5bc5dba3f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:14:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ba8615b0-49a6-4ded-b765-288f8b549899 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:39 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ba8615b0-49a6-4ded-b765-288f8b549899 Jun 02 16:14:39 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:40 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-b159ca36-6512-4867-8eb9-b20a7a69f3a4 tempest-GroupsTest-158943942 None] Group tempest-GroupsTest-Group-218392867: creating Jun 02 16:14:40 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ba8615b0-49a6-4ded-b765-288f8b549899" returned: 0 in 0.750s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ba8615b0-49a6-4ded-b765-288f8b549899 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:40 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-b159ca36-6512-4867-8eb9-b20a7a69f3a4 tempest-GroupsTest-158943942 None] Group tempest-GroupsTest-Group-218392867: created successfully Jun 02 16:14:40 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ba8615b0-49a6-4ded-b765-288f8b549899 Jun 02 16:14:40 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:40 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-b159ca36-6512-4867-8eb9-b20a7a69f3a4 tempest-GroupsTest-158943942 None] Create group completed successfully. Jun 02 16:14:41 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ba8615b0-49a6-4ded-b765-288f8b549899" returned: 0 in 0.625s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] Lock "cinder-quobyte-ba8615b0-49a6-4ded-b765-288f8b549899" released by "delete_volume" :: held 1.421s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:14:41 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] Created reservations ['68a54427-c1b4-45e8-b2bc-bc09e62a5ed8', 'c553886d-4358-4017-93bd-3032de75d2d5', 'cc4dcc78-19e6-4ca1-b20a-afe8046c3c13', 'c8c401c9-94b4-450e-baec-f0dcbfb7bc0e'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:14:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:14:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:14:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:41 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:14:41 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:41 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.661s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:41 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:14:41 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] Deleted volume successfully. Jun 02 16:14:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-56ab7c2f-3368-4aa2-b309-294ca479fad2 tempest-AttachVolumeNegativeTest-705416858 None] Lock "cinder-ba8615b0-49a6-4ded-b765-288f8b549899-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:14:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "cinder-3b1f13f0-a168-4d72-8272-f4b2a2e049ef-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] Lock "cinder-3b1f13f0-a168-4d72-8272-f4b2a2e049ef-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "cinder-quobyte-3b1f13f0-a168-4d72-8272-f4b2a2e049ef" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] Lock "cinder-quobyte-3b1f13f0-a168-4d72-8272-f4b2a2e049ef" acquired by "delete_volume" :: waited 0.019s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a097033d-688b-4463-9d50-21849919f999]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Flow 'volume_create_manager' (08b04200-74d1-463c-82f9-02e255376b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ad579e-5d75-49b1-856d-2821be26c935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ad579e-5d75-49b1-856d-2821be26c935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-601222909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc0944b3-9330-45d1-afd1-ea3d7af38f70,host='devstack@QuobyteHD#QuobyteHD',id=e3cb219a-cd73-43cb-9238-6832e06fa1cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696cbae9e7034454adb0f9c59e151ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:14:42Z,use_quota=True,user_id='7b4b6d2d5c394179aba04692e7c2b514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e252a378-1c47-4789-bfd8-5708c05f5c10),volume_type_id=e252a378-1c47-4789-bfd8-5708c05f5c10)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92411f7b-3e97-4acb-b94a-07154eefb40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92411f7b-3e97-4acb-b94a-07154eefb40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f98bd59-7546-466a-a287-2bd15157ec94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f98bd59-7546-466a-a287-2bd15157ec94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3cb219a-cd73-43cb-9238-6832e06fa1cd', 'volume_name': 'volume-e3cb219a-cd73-43cb-9238-6832e06fa1cd', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e618bd5-ba37-469a-b49e-6be8d3e51825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e618bd5-ba37-469a-b49e-6be8d3e51825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9e3b59-5c80-4ccb-9628-4272e441d0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:42 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Volume e3cb219a-cd73-43cb-9238-6832e06fa1cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3cb219a-cd73-43cb-9238-6832e06fa1cd', 'volume_size': 1} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fc0944b3-9330-45d1-afd1-ea3d7af38f70,created_at=2026-06-02T14:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-601222909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc0944b3-9330-45d1-afd1-ea3d7af38f70,host='devstack@QuobyteHD#QuobyteHD',id=e3cb219a-cd73-43cb-9238-6832e06fa1cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696cbae9e7034454adb0f9c59e151ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:14:42Z,use_quota=True,user_id='7b4b6d2d5c394179aba04692e7c2b514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e252a378-1c47-4789-bfd8-5708c05f5c10),volume_type_id=e252a378-1c47-4789-bfd8-5708c05f5c10)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Creating volume e3cb219a-cd73-43cb-9238-6832e06fa1cd {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:14:42 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef Jun 02 16:14:42 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:14:42 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:14:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e3cb219a-cd73-43cb-9238-6832e06fa1cd 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:42 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e3cb219a-cd73-43cb-9238-6832e06fa1cd 1073741824 Jun 02 16:14:42 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:43 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef" returned: 0 in 0.952s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:43 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef Jun 02 16:14:43 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:43 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e3cb219a-cd73-43cb-9238-6832e06fa1cd 1073741824" returned: 0 in 1.121s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e3cb219a-cd73-43cb-9238-6832e06fa1cd {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:43 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e3cb219a-cd73-43cb-9238-6832e06fa1cd Jun 02 16:14:43 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:43 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3b1f13f0-a168-4d72-8272-f4b2a2e049ef" returned: 0 in 0.918s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:44 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] Lock "cinder-quobyte-3b1f13f0-a168-4d72-8272-f4b2a2e049ef" released by "delete_volume" :: held 1.933s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:14:44 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] Created reservations ['08dadc7f-4915-4941-9007-4d32e699aca7', '5cd2e44f-f13f-4889-9da9-6906046ff226', '6f8b1614-640e-4537-86d8-4917070812f2', '2f74955a-b41f-4007-84de-f176c5ec542e'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:14:44 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e3cb219a-cd73-43cb-9238-6832e06fa1cd" returned: 0 in 0.716s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:14:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9e3b59-5c80-4ccb-9628-4272e441d0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3cb219a-cd73-43cb-9238-6832e06fa1cd', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd30aac-82a1-4ba0-808b-f8c355bf796c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:14:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:14:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:44 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Volume volume-e3cb219a-cd73-43cb-9238-6832e06fa1cd (e3cb219a-cd73-43cb-9238-6832e06fa1cd): created successfully Jun 02 16:14:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd30aac-82a1-4ba0-808b-f8c355bf796c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Flow 'volume_create_manager' (08b04200-74d1-463c-82f9-02e255376b9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:14:44 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:14:44 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-c3e2dc89-6c1f-4e91-bdb6-f954e3616246 tempest-GroupsTest-158943942 None] Created volume successfully. Jun 02 16:14:44 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "cinder-9abedbd5-25f3-4309-aada-a1a884872d87-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] Lock "cinder-9abedbd5-25f3-4309-aada-a1a884872d87-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "cinder-quobyte-9abedbd5-25f3-4309-aada-a1a884872d87" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] Lock "cinder-quobyte-9abedbd5-25f3-4309-aada-a1a884872d87" acquired by "delete_volume" :: waited 0.028s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[139c5110-0213-4acb-b52b-68965341173b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9abedbd5-25f3-4309-aada-a1a884872d87 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:45 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.114s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:14:45 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] Deleted volume successfully. Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fd4c1471-a4e1-44a8-9f31-606efacc65dd tempest-AttachVolumeNegativeTest-705416858 None] Lock "cinder-3b1f13f0-a168-4d72-8272-f4b2a2e049ef-delete_volume" released by "delete_volume" :: held 3.312s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:14:45 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9abedbd5-25f3-4309-aada-a1a884872d87 Jun 02 16:14:45 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Flow 'volume_create_manager' (b3995618-a7bb-40b2-acb2-415b4c0b6866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43bedc12-1a58-45bb-8bc3-3f9148e61116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43bedc12-1a58-45bb-8bc3-3f9148e61116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1236733554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc0944b3-9330-45d1-afd1-ea3d7af38f70,host='devstack@QuobyteHD#QuobyteHD',id=818a8aba-2f08-4851-b976-074e2fe10a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696cbae9e7034454adb0f9c59e151ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:14:45Z,use_quota=True,user_id='7b4b6d2d5c394179aba04692e7c2b514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e252a378-1c47-4789-bfd8-5708c05f5c10),volume_type_id=e252a378-1c47-4789-bfd8-5708c05f5c10)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d407014-3ffb-4f81-b05d-c7be130278e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d407014-3ffb-4f81-b05d-c7be130278e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7b5275-b2b9-4474-8bef-8ef1d46fa47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7b5275-b2b9-4474-8bef-8ef1d46fa47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '818a8aba-2f08-4851-b976-074e2fe10a90', 'volume_name': 'volume-818a8aba-2f08-4851-b976-074e2fe10a90', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (321d376e-69e9-406a-8ca7-65436d891a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (321d376e-69e9-406a-8ca7-65436d891a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07fb48ca-c96f-46ff-8f3f-5dfa5c810a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:45 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Volume 818a8aba-2f08-4851-b976-074e2fe10a90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-818a8aba-2f08-4851-b976-074e2fe10a90', 'volume_size': 1} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fc0944b3-9330-45d1-afd1-ea3d7af38f70,created_at=2026-06-02T14:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1236733554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc0944b3-9330-45d1-afd1-ea3d7af38f70,host='devstack@QuobyteHD#QuobyteHD',id=818a8aba-2f08-4851-b976-074e2fe10a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696cbae9e7034454adb0f9c59e151ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:14:45Z,use_quota=True,user_id='7b4b6d2d5c394179aba04692e7c2b514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e252a378-1c47-4789-bfd8-5708c05f5c10),volume_type_id=e252a378-1c47-4789-bfd8-5708c05f5c10)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Creating volume 818a8aba-2f08-4851-b976-074e2fe10a90 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:14:45 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:14:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-818a8aba-2f08-4851-b976-074e2fe10a90 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:45 devstack sudo[94817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-818a8aba-2f08-4851-b976-074e2fe10a90 1073741824 Jun 02 16:14:45 devstack sudo[94817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:46 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9abedbd5-25f3-4309-aada-a1a884872d87" returned: 0 in 0.795s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9abedbd5-25f3-4309-aada-a1a884872d87 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:46 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9abedbd5-25f3-4309-aada-a1a884872d87 Jun 02 16:14:46 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:46 devstack sudo[94817]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-818a8aba-2f08-4851-b976-074e2fe10a90 1073741824" returned: 0 in 0.957s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-818a8aba-2f08-4851-b976-074e2fe10a90 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:46 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-818a8aba-2f08-4851-b976-074e2fe10a90 Jun 02 16:14:46 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:46 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9abedbd5-25f3-4309-aada-a1a884872d87" returned: 0 in 0.919s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] Lock "cinder-quobyte-9abedbd5-25f3-4309-aada-a1a884872d87" released by "delete_volume" :: held 1.802s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:14:47 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] Created reservations ['c03180e7-c941-409e-981a-ae6f708e936e', '0e5a9a8c-ab42-4fde-a82b-d84a867f9140', '8ffa3e57-3d99-463b-9674-f11cd340c99f', '59664916-dc5e-4d6b-8cae-1810d393dab3'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:14:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:47 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:14:47 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:14:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:47 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:14:47 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:47 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-c1c979c3-d5fc-4a5e-a12e-e4450960ea60 req-072becd6-0f92-44ff-afbe-f7cdfec3a9e5 tempest-ServerActionsTestOtherA-1811101398 None] Terminate volume connection completed successfully. Jun 02 16:14:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-c1c979c3-d5fc-4a5e-a12e-e4450960ea60 req-072becd6-0f92-44ff-afbe-f7cdfec3a9e5 tempest-ServerActionsTestOtherA-1811101398 None] Deleting attachment 80210ea0-2c3b-436e-a99c-c0b89df01581. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:14:47 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-818a8aba-2f08-4851-b976-074e2fe10a90" returned: 0 in 1.077s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:47 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] <== create_volume: return (2101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:14:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07fb48ca-c96f-46ff-8f3f-5dfa5c810a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-818a8aba-2f08-4851-b976-074e2fe10a90', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fcebc2-6b89-4a57-bb14-a91585e665c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:47 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Volume volume-818a8aba-2f08-4851-b976-074e2fe10a90 (818a8aba-2f08-4851-b976-074e2fe10a90): created successfully Jun 02 16:14:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fcebc2-6b89-4a57-bb14-a91585e665c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:47 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Flow 'volume_create_manager' (b3995618-a7bb-40b2-acb2-415b4c0b6866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:14:47 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-d323e702-104a-439b-81d4-0e3b49acd7aa tempest-GroupsTest-158943942 None] Created volume successfully. Jun 02 16:14:47 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.798s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:47 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:14:47 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] Deleted volume successfully. Jun 02 16:14:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-475b3d91-0b16-4779-bb17-eb71f88f67d5 tempest-AttachVolumeNegativeTest-705416858 None] Lock "cinder-9abedbd5-25f3-4309-aada-a1a884872d87-delete_volume" released by "delete_volume" :: held 2.934s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:14:48 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-70f92b06-214a-4186-8fd3-9bae02513f0b tempest-GroupsTest-158943942 None] Update group completed successfully. Jun 02 16:14:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-c1c979c3-d5fc-4a5e-a12e-e4450960ea60 req-14a43b85-81a2-484f-bffb-b8a53210931d tempest-ServerActionsTestOtherA-1811101398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-c1c979c3-d5fc-4a5e-a12e-e4450960ea60 req-14a43b85-81a2-484f-bffb-b8a53210931d tempest-ServerActionsTestOtherA-1811101398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:49 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a5a7ed-c15e-4e40-9670-c591f902d640]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:14:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-c1c979c3-d5fc-4a5e-a12e-e4450960ea60 req-14a43b85-81a2-484f-bffb-b8a53210931d tempest-ServerActionsTestOtherA-1811101398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:49 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f Jun 02 16:14:49 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:50 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-13cf9597-e534-4915-9629-205b2f6ce052 tempest-GroupsTest-158943942 None] Update group completed successfully. Jun 02 16:14:51 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-c1c979c3-d5fc-4a5e-a12e-e4450960ea60 req-14a43b85-81a2-484f-bffb-b8a53210931d tempest-ServerActionsTestOtherA-1811101398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f" returned: 0 in 1.307s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-c1c979c3-d5fc-4a5e-a12e-e4450960ea60 req-14a43b85-81a2-484f-bffb-b8a53210931d tempest-ServerActionsTestOtherA-1811101398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.331s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-c1c979c3-d5fc-4a5e-a12e-e4450960ea60 req-14a43b85-81a2-484f-bffb-b8a53210931d tempest-ServerActionsTestOtherA-1811101398 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-265baad1-5897-4717-8211-1410a053174f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41b178ec-bbe9-4153-93f5-c37815ab20f9', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:14:51 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-c1c979c3-d5fc-4a5e-a12e-e4450960ea60 req-14a43b85-81a2-484f-bffb-b8a53210931d tempest-ServerActionsTestOtherA-1811101398 None] attachment_update completed successfully. Jun 02 16:14:52 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Acquiring lock "cinder-quobyte-818a8aba-2f08-4851-b976-074e2fe10a90" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:14:52 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Lock "cinder-quobyte-818a8aba-2f08-4851-b976-074e2fe10a90" acquired by "delete_volume" :: waited 0.037s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:14:52 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2895a4e9-ad66-4b65-9ad8-e2878ba23d97]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:14:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-818a8aba-2f08-4851-b976-074e2fe10a90 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:52 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-818a8aba-2f08-4851-b976-074e2fe10a90 Jun 02 16:14:52 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:53 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-818a8aba-2f08-4851-b976-074e2fe10a90" returned: 0 in 1.072s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-818a8aba-2f08-4851-b976-074e2fe10a90 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:53 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-818a8aba-2f08-4851-b976-074e2fe10a90 Jun 02 16:14:53 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:54 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-818a8aba-2f08-4851-b976-074e2fe10a90" returned: 0 in 1.071s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:54 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Lock "cinder-quobyte-818a8aba-2f08-4851-b976-074e2fe10a90" released by "delete_volume" :: held 2.254s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:14:54 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Acquiring lock "cinder-quobyte-e3cb219a-cd73-43cb-9238-6832e06fa1cd" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:14:54 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Lock "cinder-quobyte-e3cb219a-cd73-43cb-9238-6832e06fa1cd" acquired by "delete_volume" :: waited 0.033s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:14:54 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cea69a-7e9b-4866-b144-605b7007ddeb]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:14:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e3cb219a-cd73-43cb-9238-6832e06fa1cd {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:54 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e3cb219a-cd73-43cb-9238-6832e06fa1cd Jun 02 16:14:54 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:55 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e3cb219a-cd73-43cb-9238-6832e06fa1cd" returned: 0 in 1.276s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e3cb219a-cd73-43cb-9238-6832e06fa1cd {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:56 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e3cb219a-cd73-43cb-9238-6832e06fa1cd Jun 02 16:14:56 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:56 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e3cb219a-cd73-43cb-9238-6832e06fa1cd" returned: 0 in 0.822s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:56 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Lock "cinder-quobyte-e3cb219a-cd73-43cb-9238-6832e06fa1cd" released by "delete_volume" :: held 2.183s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:14:56 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Created reservations ['79064fe5-74c4-4eaa-8bae-8593116294f8'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:14:56 devstack cinder-volume[86488]: WARNING cinder.quota [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-285419534 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-285419534, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:14:56 devstack cinder-volume[86488]: WARNING cinder.quota [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-285419534 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-285419534, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:14:56 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Created reservations ['1bc5ea3e-03a0-4b88-a586-e5d7a34c887a', 'ad6d7599-0a7c-4484-b22f-d39dea21319b', '1e407e26-3527-4adf-9a96-a680227fbeab', '18b4226d-49ed-475f-9662-1870e32a1585'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:14:57 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Created reservations ['a9e11dca-c0fd-4187-9575-720a66b6241e', 'c5220971-eb31-4403-8e5f-f35abcd8fffb', 'acd9ed2a-8632-408e-bb4c-d3d03ce8ab41', 'bc00da8f-c778-42ea-bcbe-ab65ff91c3d0'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:14:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:14:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:14:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:57 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:14:57 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:14:58 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Jun 02 16:14:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.768s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:14:58 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:14:58 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f694c147-7e69-473e-9d5a-c6d5133d2ce8 tempest-GroupsTest-158943942 None] Delete group completed successfully. Jun 02 16:14:58 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:14:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Flow 'volume_create_manager' (5a770bd6-6278-4e89-9ee3-69c84f6f7ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:14:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0229f2a1-e6fd-465a-9512-da9b40a96572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:58 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=110,cinder:INSERT=24,cinder:UPDATE=114,cinder:DELETE=3 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0229f2a1-e6fd-465a-9512-da9b40a96572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1005660037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509bb84f-73b5-48c6-862c-aba9d0d40a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='addc7ff10b2147408fdc076f22d01ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:14:59Z,use_quota=True,user_id='8690a9dfd28642068ea3e375170d21b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db1f69a-ee9b-41f2-86c0-c16d6569bd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db1f69a-ee9b-41f2-86c0-c16d6569bd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c63c309-215b-4ee7-a463-583014b42894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c63c309-215b-4ee7-a463-583014b42894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '509bb84f-73b5-48c6-862c-aba9d0d40a7a', 'volume_name': 'volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3e97b4-8dfa-451c-847e-4b8f856d422a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3e97b4-8dfa-451c-847e-4b8f856d422a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d884a403-fcbd-4586-98eb-ba0cf5e8ea7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:14:59 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Volume 509bb84f-73b5-48c6-862c-aba9d0d40a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a', 'volume_size': 1} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1005660037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509bb84f-73b5-48c6-862c-aba9d0d40a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='addc7ff10b2147408fdc076f22d01ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:14:59Z,use_quota=True,user_id='8690a9dfd28642068ea3e375170d21b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Creating volume 509bb84f-73b5-48c6-862c-aba9d0d40a7a {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:14:59 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:14:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:14:59 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a 1073741824 Jun 02 16:14:59 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:15:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:15:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:15:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:00 devstack sudo[95443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:15:00 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:00 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a 1073741824" returned: 0 in 1.548s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:00 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a Jun 02 16:15:00 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:01 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.120s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:01 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:15:02 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a" returned: 0 in 1.463s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] <== create_volume: return (3091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:15:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.094s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d884a403-fcbd-4586-98eb-ba0cf5e8ea7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23f05bd-0b2d-4790-9464-76004b63d4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:02 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Volume volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a (509bb84f-73b5-48c6-862c-aba9d0d40a7a): created successfully Jun 02 16:15:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23f05bd-0b2d-4790-9464-76004b63d4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Flow 'volume_create_manager' (5a770bd6-6278-4e89-9ee3-69c84f6f7ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:15:02 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-4f6e4a72-7f93-4ece-818e-a36234fb8fe4 req-bfc84726-1a4e-4120-a5b5-6de2a5fb5db8 tempest-VolumesSnapshotsTestJSON-183623633 None] Created volume successfully. Jun 02 16:15:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] Creating offline snapshot 11b84463-116f-46e9-adef-21559c602a4b of volume 509bb84f-73b5-48c6-862c-aba9d0d40a7a {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:15:04 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b991af53-b526-451b-96d3-b1106b54bfa0]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:15:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:04 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a Jun 02 16:15:04 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:05 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a" returned: 0 in 1.077s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:05 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b 1G Jun 02 16:15:05 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:06 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b 1G" returned: 0 in 0.906s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:06 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b Jun 02 16:15:06 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:07 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b" returned: 0 in 0.903s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:07 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b is being set with open permissions: ugo+rw Jun 02 16:15:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:07 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b Jun 02 16:15:07 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:07 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b" returned: 0 in 0.681s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:07 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.info Jun 02 16:15:07 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:08 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.info" returned: 0 in 0.657s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:08 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.info is being set with open permissions: ugo+rw Jun 02 16:15:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:08 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.info Jun 02 16:15:08 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:09 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.info" returned: 0 in 0.669s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.045s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:09 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-2e47d7ac-6430-4ba7-aaa7-1f794145cd81 req-86c23aaa-0ca9-4b1d-b72b-d77877ca29c9 tempest-VolumesSnapshotsTestJSON-183623633 None] Create snapshot completed successfully Jun 02 16:15:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Acquiring lock "cinder-11b84463-116f-46e9-adef-21559c602a4b-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "cinder-11b84463-116f-46e9-adef-21559c602a4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Acquiring lock "cinder-quobyte-509bb84f-73b5-48c6-862c-aba9d0d40a7a" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "cinder-quobyte-509bb84f-73b5-48c6-862c-aba9d0d40a7a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Acquiring lock "cinder-quobyte-11b84463-116f-46e9-adef-21559c602a4b" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "cinder-quobyte-11b84463-116f-46e9-adef-21559c602a4b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Deleting offline snapshot 11b84463-116f-46e9-adef-21559c602a4b of volume 509bb84f-73b5-48c6-862c-aba9d0d40a7a {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:15:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] snapshot_file for this snap is: volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:15:10 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bed54f-2b92-45ae-b06f-051b0d76cecf]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:15:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:10 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b Jun 02 16:15:10 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:11 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b" returned: 0 in 0.830s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:11 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:15:11 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3caf7a-d222-49d4-ab1b-3d7a36e2bfdf]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:15:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:11 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a Jun 02 16:15:11 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:12 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a" returned: 0 in 0.741s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:12 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b Jun 02 16:15:12 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:12 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b" returned: 0 in 0.765s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:12 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b Jun 02 16:15:12 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:13 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a.11b84463-116f-46e9-adef-21559c602a4b" returned: 0 in 0.692s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "cinder-quobyte-11b84463-116f-46e9-adef-21559c602a4b" released by "_delete_snapshot" :: held 3.200s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:15:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "cinder-quobyte-509bb84f-73b5-48c6-862c-aba9d0d40a7a" released by "delete_snapshot" :: held 3.235s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:15:13 devstack cinder-volume[86488]: WARNING cinder.quota [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:15:13 devstack cinder-volume[86488]: DEBUG cinder.quota [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Created reservations ['62636879-ebb7-49aa-99eb-3cad14177e90', '15a38644-c549-4081-bcf0-9f40e910a4ec', 'd50d0287-4897-489b-beb2-651c528322d7', '65ec0613-7920-48d7-be8c-9680441ae641'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:15:13 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Delete snapshot completed successfully. Jun 02 16:15:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-ae873aad-8cbb-493e-82d3-799708816915 req-1a262528-92f0-4a8c-864c-7d5009676932 tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "cinder-11b84463-116f-46e9-adef-21559c602a4b-delete_snapshot" released by "delete_snapshot" :: held 3.487s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:15:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] Acquiring lock "cinder-509bb84f-73b5-48c6-862c-aba9d0d40a7a-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "cinder-509bb84f-73b5-48c6-862c-aba9d0d40a7a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] Acquiring lock "cinder-quobyte-509bb84f-73b5-48c6-862c-aba9d0d40a7a" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "cinder-quobyte-509bb84f-73b5-48c6-862c-aba9d0d40a7a" acquired by "delete_volume" :: waited 0.024s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:15 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d49221b-860e-49d5-b6b5-f4a562536849]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:15:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:15 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a Jun 02 16:15:15 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:15 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a" returned: 0 in 0.857s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:15 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a Jun 02 16:15:15 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:15:16 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Flow 'volume_create_manager' (f91eca09-ea91-4ab6-af22-46729e274498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c837bd1-68db-4b85-bf9f-61afd80a6a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-509bb84f-73b5-48c6-862c-aba9d0d40a7a" returned: 0 in 0.758s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c837bd1-68db-4b85-bf9f-61afd80a6a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1433390021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63104a7d-0817-4529-9975-db6fe4ad2618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d913956a9dc4f6c99a5ebfb51344a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:15:17Z,use_quota=True,user_id='3254ff57b2614172ae5dbd611bc8b934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e414db-903e-4309-ac75-2a23dbf288ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e414db-903e-4309-ac75-2a23dbf288ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6f1553-2424-4ddf-bb26-dbcbae3efc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6f1553-2424-4ddf-bb26-dbcbae3efc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63104a7d-0817-4529-9975-db6fe4ad2618', 'volume_name': 'volume-63104a7d-0817-4529-9975-db6fe4ad2618', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20d9247-ec4a-4fbe-8c78-9892a8531cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20d9247-ec4a-4fbe-8c78-9892a8531cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477c9b1b-0203-4591-9b64-b451e944b9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:16 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Volume 63104a7d-0817-4529-9975-db6fe4ad2618: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63104a7d-0817-4529-9975-db6fe4ad2618', 'volume_size': 1} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1433390021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63104a7d-0817-4529-9975-db6fe4ad2618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d913956a9dc4f6c99a5ebfb51344a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:15:17Z,use_quota=True,user_id='3254ff57b2614172ae5dbd611bc8b934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Creating volume 63104a7d-0817-4529-9975-db6fe4ad2618 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:15:16 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-63104a7d-0817-4529-9975-db6fe4ad2618 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "cinder-quobyte-509bb84f-73b5-48c6-862c-aba9d0d40a7a" released by "delete_volume" :: held 1.756s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:15:16 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-63104a7d-0817-4529-9975-db6fe4ad2618 1073741824 Jun 02 16:15:16 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.quota [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] Created reservations ['c71ac83d-4076-41ef-b195-24a8ff96b89e', 'eec167c2-f9f5-484b-8452-b4bdc164782b', 'e0a5a107-1fd6-48ed-b60a-f7722e4a63f2', '7c81c87e-80b8-41f9-89ee-9fa1c46eb50f'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:16 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:15:16 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:17 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-63104a7d-0817-4529-9975-db6fe4ad2618 1073741824" returned: 0 in 1.011s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:17 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.807s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:17 devstack cinder-volume[86488]: DEBUG cinder.manager [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:15:17 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] Deleted volume successfully. Jun 02 16:15:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-63104a7d-0817-4529-9975-db6fe4ad2618 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-6d0608e2-da5b-4c75-9f51-7d2580ea9838 req-59d9b85b-ac1c-4dd4-8c79-1249edde1fcb tempest-VolumesSnapshotsTestJSON-183623633 None] Lock "cinder-509bb84f-73b5-48c6-862c-aba9d0d40a7a-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:15:17 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-63104a7d-0817-4529-9975-db6fe4ad2618 Jun 02 16:15:17 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:18 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-63104a7d-0817-4529-9975-db6fe4ad2618" returned: 0 in 0.661s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:15:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477c9b1b-0203-4591-9b64-b451e944b9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63104a7d-0817-4529-9975-db6fe4ad2618', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bd0ad1-d35e-4b48-83e0-5c68dc35ba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:18 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Volume volume-63104a7d-0817-4529-9975-db6fe4ad2618 (63104a7d-0817-4529-9975-db6fe4ad2618): created successfully Jun 02 16:15:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bd0ad1-d35e-4b48-83e0-5c68dc35ba82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Flow 'volume_create_manager' (f91eca09-ea91-4ab6-af22-46729e274498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:15:18 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0c27d628-befa-4fa3-a805-8a4aacab8655 tempest-AttachVolumeShelveTestJSON-801041235 None] Created volume successfully. Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Flow 'volume_create_manager' (9870a602-7fc7-4a1c-818d-aeb1a12cbf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c404ada-2d54-4017-afb1-3955a37dc9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c404ada-2d54-4017-afb1-3955a37dc9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1565191463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36f2a23-9b53-4ad1-b216-c5a18d30317c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a866861ca742589914e1eb44fffb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:15:20Z,use_quota=True,user_id='5428b237aa574a4a8ea78e4b2a66e118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9848ce-7d30-4773-8349-1bddb21d7938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9848ce-7d30-4773-8349-1bddb21d7938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452a8bb9-6028-403e-be92-c18d596521fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452a8bb9-6028-403e-be92-c18d596521fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a36f2a23-9b53-4ad1-b216-c5a18d30317c', 'volume_name': 'volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb18630-8389-4d74-b294-02bec9255f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb18630-8389-4d74-b294-02bec9255f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef2e980-4f6c-4c77-af55-834403e95172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:19 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Volume a36f2a23-9b53-4ad1-b216-c5a18d30317c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c', 'volume_size': 1} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1565191463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36f2a23-9b53-4ad1-b216-c5a18d30317c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a866861ca742589914e1eb44fffb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:15:20Z,use_quota=True,user_id='5428b237aa574a4a8ea78e4b2a66e118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Creating volume a36f2a23-9b53-4ad1-b216-c5a18d30317c {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:15:19 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:15:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:19 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c 1073741824 Jun 02 16:15:19 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:20 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c 1073741824" returned: 0 in 0.959s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:20 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c Jun 02 16:15:20 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:21 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c" returned: 0 in 0.761s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:15:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef2e980-4f6c-4c77-af55-834403e95172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb61ba4-6881-4934-9f24-39e2007f74eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:21 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Volume volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c (a36f2a23-9b53-4ad1-b216-c5a18d30317c): created successfully Jun 02 16:15:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb61ba4-6881-4934-9f24-39e2007f74eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Flow 'volume_create_manager' (9870a602-7fc7-4a1c-818d-aeb1a12cbf69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:15:21 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f01a5289-6276-4fc8-a8f3-231b48e8e6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Created volume successfully. Jun 02 16:15:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Creating offline snapshot 108d4cd1-1a41-4ab7-b71a-44bc7da016b3 of volume a36f2a23-9b53-4ad1-b216-c5a18d30317c {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:15:22 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[c765d22e-36c3-468a-b02d-c3e8298a5030]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:15:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:22 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c Jun 02 16:15:22 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:23 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c" returned: 0 in 1.023s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:23 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3 1G Jun 02 16:15:23 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:24 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3 1G" returned: 0 in 0.847s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:24 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3 Jun 02 16:15:24 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:25 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3" returned: 0 in 0.832s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:25 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3 is being set with open permissions: ugo+rw Jun 02 16:15:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:25 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3 Jun 02 16:15:25 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:26 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3" returned: 0 in 0.838s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:26 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.info Jun 02 16:15:26 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:26 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.info" returned: 0 in 0.667s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:26 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.info is being set with open permissions: ugo+rw Jun 02 16:15:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:26 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.info Jun 02 16:15:26 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:27 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.info" returned: 0 in 0.638s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.990s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-738899d6-7136-4907-91ce-45f9225934dd tempest-BackendsCapabilitiesAdminTestsJSON-421472843 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757984161377, 'free_capacity_gb': 1775.757984161377, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86488) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 02 16:15:27 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-74ba343c-1d4e-49e2-9954-6d096bf7d271 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Create snapshot completed successfully Jun 02 16:15:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-af83e88b-52e7-4e34-9950-a20fe6eb045e tempest-BackendsCapabilitiesAdminTestsJSON-421472843 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757984161377, 'free_capacity_gb': 1775.757984161377, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86488) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 02 16:15:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Acquiring lock "cinder-108d4cd1-1a41-4ab7-b71a-44bc7da016b3-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "cinder-108d4cd1-1a41-4ab7-b71a-44bc7da016b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Acquiring lock "cinder-quobyte-a36f2a23-9b53-4ad1-b216-c5a18d30317c" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "cinder-quobyte-a36f2a23-9b53-4ad1-b216-c5a18d30317c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Acquiring lock "cinder-quobyte-108d4cd1-1a41-4ab7-b71a-44bc7da016b3" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "cinder-quobyte-108d4cd1-1a41-4ab7-b71a-44bc7da016b3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Deleting offline snapshot 108d4cd1-1a41-4ab7-b71a-44bc7da016b3 of volume a36f2a23-9b53-4ad1-b216-c5a18d30317c {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:15:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] snapshot_file for this snap is: volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:15:28 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88ef70b-572f-4a02-950c-859b8eb7c72c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:15:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:28 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3 Jun 02 16:15:28 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:28 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-6bfc423b-a2ef-442b-a883-ba83baa8a1e7 req-f93503f2-5986-4e04-933b-c8916393df0b tempest-ServerActionsTestOtherA-1811101398 None] Terminate volume connection completed successfully. Jun 02 16:15:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-6bfc423b-a2ef-442b-a883-ba83baa8a1e7 req-f93503f2-5986-4e04-933b-c8916393df0b tempest-ServerActionsTestOtherA-1811101398 None] Deleting attachment 41b178ec-bbe9-4153-93f5-c37815ab20f9. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:15:29 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3" returned: 0 in 0.822s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:15:29 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6992296-b422-47a1-9456-732bc037470a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:15:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:29 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c Jun 02 16:15:29 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:30 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c" returned: 0 in 0.894s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:30 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3 Jun 02 16:15:30 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:30 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3" returned: 0 in 0.806s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:30 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3 Jun 02 16:15:30 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:31 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c.108d4cd1-1a41-4ab7-b71a-44bc7da016b3" returned: 0 in 0.807s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:31 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=90,cinder:UPDATE=92,cinder:INSERT=19,cinder:DELETE=9 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:15:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "cinder-quobyte-108d4cd1-1a41-4ab7-b71a-44bc7da016b3" released by "_delete_snapshot" :: held 3.478s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:15:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "cinder-quobyte-a36f2a23-9b53-4ad1-b216-c5a18d30317c" released by "delete_snapshot" :: held 3.513s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:15:31 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Created reservations ['ebe4d226-0a53-4fd4-b970-555f6a7305a1', 'c88df821-a282-4bac-a75e-6f9590973ad8', '5120735a-c8ff-42fa-8a93-d04455816391', 'b07588e8-fca5-488a-858b-a5789f27f47a'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:15:31 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Delete snapshot completed successfully. Jun 02 16:15:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-199de684-f642-40cc-aaa3-b1d42653b1d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "cinder-108d4cd1-1a41-4ab7-b71a-44bc7da016b3-delete_snapshot" released by "delete_snapshot" :: held 3.706s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:15:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Acquiring lock "cinder-a36f2a23-9b53-4ad1-b216-c5a18d30317c-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "cinder-a36f2a23-9b53-4ad1-b216-c5a18d30317c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Acquiring lock "cinder-quobyte-a36f2a23-9b53-4ad1-b216-c5a18d30317c" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "cinder-quobyte-a36f2a23-9b53-4ad1-b216-c5a18d30317c" acquired by "delete_volume" :: waited 0.026s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:32 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4586430-7cc5-4ceb-9fc6-500cc490efc8]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:15:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:32 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c Jun 02 16:15:32 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:33 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c" returned: 0 in 1.040s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:33 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c Jun 02 16:15:33 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:34 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-72c6fbe0-b823-491a-a91e-1cf6d24f0706 tempest-GroupSnapshotsTest-1776319603 None] Group tempest-GroupSnapshotsTest-Group-440336686: creating Jun 02 16:15:34 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a36f2a23-9b53-4ad1-b216-c5a18d30317c" returned: 0 in 0.839s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "cinder-quobyte-a36f2a23-9b53-4ad1-b216-c5a18d30317c" released by "delete_volume" :: held 1.983s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:15:34 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-72c6fbe0-b823-491a-a91e-1cf6d24f0706 tempest-GroupSnapshotsTest-1776319603 None] Group tempest-GroupSnapshotsTest-Group-440336686: created successfully Jun 02 16:15:34 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-72c6fbe0-b823-491a-a91e-1cf6d24f0706 tempest-GroupSnapshotsTest-1776319603 None] Create group completed successfully. Jun 02 16:15:34 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Created reservations ['e5e676fe-b5b6-4c69-86c1-06c59f6dd154', 'e8644a1c-4096-42f1-b07e-9ca199b07f94', '851a72eb-f42e-4c4b-89ee-485f47cc3ee5', '9b2323c3-ac8e-4b59-821e-0b489942a7ae'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:15:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:15:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:15:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:34 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:15:34 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-f38a7dce-272d-4df9-8d6f-6fa89e824fa0 req-75746619-50fc-49a1-8048-9532066a5d7a tempest-AttachVolumeShelveTestJSON-801041235 None] No connector for attachment 5eacfb35-86bd-4d35-9754-b390fe49fa9d; skipping storage backend terminate_connection call. {{(pid=86488) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 02 16:15:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-f38a7dce-272d-4df9-8d6f-6fa89e824fa0 req-75746619-50fc-49a1-8048-9532066a5d7a tempest-AttachVolumeShelveTestJSON-801041235 None] Deleting attachment 5eacfb35-86bd-4d35-9754-b390fe49fa9d. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:15:35 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.669s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:35 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:15:35 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Deleted volume successfully. Jun 02 16:15:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7a694ae6-1ed3-4138-b56d-c085eb75e906 tempest-VolumeSnapshotQuotasNegativeTestJSON-898176862 None] Lock "cinder-a36f2a23-9b53-4ad1-b216-c5a18d30317c-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Flow 'volume_create_manager' (229afdf6-540d-44b9-a870-c9f18f4a1936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d30f4b-3350-426a-a93a-6863847e616f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d30f4b-3350-426a-a93a-6863847e616f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-12630476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8b4dea4c-5c8e-4346-b47f-0ce53d4dec9d,host='devstack@QuobyteHD#QuobyteHD',id=b7841e6f-83d5-4bbd-a391-5d618418893a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8687de7ed5a44b4fa1653b86ff51bebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:15:36Z,use_quota=True,user_id='b0e2967420ab4f6282af354d4b206ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c32f4155-4db3-4fea-9189-e41fca9edf3b),volume_type_id=c32f4155-4db3-4fea-9189-e41fca9edf3b)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42095591-854b-4429-8170-c439d74c84df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42095591-854b-4429-8170-c439d74c84df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cadca1-f9c4-4750-985f-c866cc9b304c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cadca1-f9c4-4750-985f-c866cc9b304c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7841e6f-83d5-4bbd-a391-5d618418893a', 'volume_name': 'volume-b7841e6f-83d5-4bbd-a391-5d618418893a', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eee5769-1446-4686-8d37-c9c761dd60fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eee5769-1446-4686-8d37-c9c761dd60fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (474df5e8-7004-4111-be99-0ede86858a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:36 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Volume b7841e6f-83d5-4bbd-a391-5d618418893a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7841e6f-83d5-4bbd-a391-5d618418893a', 'volume_size': 1} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8b4dea4c-5c8e-4346-b47f-0ce53d4dec9d,created_at=2026-06-02T14:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-12630476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8b4dea4c-5c8e-4346-b47f-0ce53d4dec9d,host='devstack@QuobyteHD#QuobyteHD',id=b7841e6f-83d5-4bbd-a391-5d618418893a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8687de7ed5a44b4fa1653b86ff51bebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:15:36Z,use_quota=True,user_id='b0e2967420ab4f6282af354d4b206ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c32f4155-4db3-4fea-9189-e41fca9edf3b),volume_type_id=c32f4155-4db3-4fea-9189-e41fca9edf3b)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Creating volume b7841e6f-83d5-4bbd-a391-5d618418893a {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:15:36 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:15:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:36 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a 1073741824 Jun 02 16:15:36 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:37 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a 1073741824" returned: 0 in 1.050s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:37 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a Jun 02 16:15:37 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:38 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a" returned: 0 in 0.805s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:15:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (474df5e8-7004-4111-be99-0ede86858a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7841e6f-83d5-4bbd-a391-5d618418893a', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee82f9c3-4012-44f5-9647-19b261d6eb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:38 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Volume volume-b7841e6f-83d5-4bbd-a391-5d618418893a (b7841e6f-83d5-4bbd-a391-5d618418893a): created successfully Jun 02 16:15:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee82f9c3-4012-44f5-9647-19b261d6eb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Flow 'volume_create_manager' (229afdf6-540d-44b9-a870-c9f18f4a1936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:15:38 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-7c0bb775-8940-4099-ac27-4f7229d6e0bd tempest-GroupSnapshotsTest-1776319603 None] Created volume successfully. Jun 02 16:15:38 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] GroupSnapshot 0f6b6924-4cee-4433-a37b-d0d0b6841759: creating. Jun 02 16:15:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] Group snapshot 0f6b6924-4cee-4433-a37b-d0d0b6841759: creating. {{(pid=86488) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 02 16:15:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] Creating offline snapshot 56540445-fb74-487b-b6e7-6b3189a0c661 of volume b7841e6f-83d5-4bbd-a391-5d618418893a {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:15:38 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ee6d04-ae85-4d2f-87b8-ba0cbd02df5b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:15:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:39 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a Jun 02 16:15:39 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:39 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a" returned: 0 in 0.834s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:39 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661 1G Jun 02 16:15:39 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] Acquiring lock "cinder-265baad1-5897-4717-8211-1410a053174f-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] Lock "cinder-265baad1-5897-4717-8211-1410a053174f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] Acquiring lock "cinder-quobyte-265baad1-5897-4717-8211-1410a053174f" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] Lock "cinder-quobyte-265baad1-5897-4717-8211-1410a053174f" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:40 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71fbb54-91ba-477e-8033-759313063b3f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:15:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:40 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f Jun 02 16:15:40 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:40 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661 1G" returned: 0 in 0.984s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7841e6f-83d5-4bbd-a391-5d618418893a -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:40 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7841e6f-83d5-4bbd-a391-5d618418893a -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661 Jun 02 16:15:40 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:40 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f" returned: 0 in 0.803s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:41 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f Jun 02 16:15:41 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:41 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7841e6f-83d5-4bbd-a391-5d618418893a -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661" returned: 0 in 0.705s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:41 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661 is being set with open permissions: ugo+rw: NotImplementedError Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:41 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661 Jun 02 16:15:41 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:41 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-265baad1-5897-4717-8211-1410a053174f" returned: 0 in 0.679s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] Lock "cinder-quobyte-265baad1-5897-4717-8211-1410a053174f" released by "delete_volume" :: held 1.550s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] Created reservations ['d7f98e04-3445-48fb-9bc4-b4d56cec0e31', '5450d4c8-c960-420a-b5bc-82adeb73833c', '68ad8971-0f06-454a-a79d-6aad42f14aff', '33276589-150a-47f7-affd-1dbdefcd6fc7'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:41 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:15:41 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Flow 'volume_create_manager' (5fb676bc-3bcc-40cb-8166-d8c81068cc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c6893a-a13a-47d0-ac1b-000322e6cf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c6893a-a13a-47d0-ac1b-000322e6cf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1500140086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a419fcb8-aa62-4777-9815-8e9b17d2645e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e30106a298e44148d5644bf84d8de6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:15:42Z,use_quota=True,user_id='b42a5428ddb34593a41d955735adc8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac7dc568-ef34-4d9f-9d2a-d4dc9c428747),volume_type_id=ac7dc568-ef34-4d9f-9d2a-d4dc9c428747)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118df064-5ece-41c6-8b17-1c64b4abc0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118df064-5ece-41c6-8b17-1c64b4abc0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f141b5f8-00ce-4c90-9bb0-8bd5277175ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f141b5f8-00ce-4c90-9bb0-8bd5277175ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a419fcb8-aa62-4777-9815-8e9b17d2645e', 'volume_name': 'volume-a419fcb8-aa62-4777-9815-8e9b17d2645e', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656e11f7-534f-4fe6-88ac-0d2c4dfe51ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656e11f7-534f-4fe6-88ac-0d2c4dfe51ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2714de5d-98b8-4b5a-a849-b1a7c8bf6fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:42 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Volume a419fcb8-aa62-4777-9815-8e9b17d2645e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a419fcb8-aa62-4777-9815-8e9b17d2645e', 'volume_size': 1} Jun 02 16:15:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:42 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661" returned: 0 in 0.711s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:42 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.info Jun 02 16:15:42 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:42 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.628s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:42 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:15:42 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] Deleted volume successfully. Jun 02 16:15:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e7f4ff36-30df-4c05-b571-38325728b985 tempest-ServerActionsTestOtherA-1811101398 None] Lock "cinder-265baad1-5897-4717-8211-1410a053174f-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:15:42 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.info" returned: 0 in 0.688s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:42 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 16:15:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:42 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.info Jun 02 16:15:42 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:43 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.info" returned: 0 in 0.689s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.737s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.608s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1500140086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a419fcb8-aa62-4777-9815-8e9b17d2645e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e30106a298e44148d5644bf84d8de6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:15:42Z,use_quota=True,user_id='b42a5428ddb34593a41d955735adc8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac7dc568-ef34-4d9f-9d2a-d4dc9c428747),volume_type_id=ac7dc568-ef34-4d9f-9d2a-d4dc9c428747)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:15:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Creating volume a419fcb8-aa62-4777-9815-8e9b17d2645e {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:15:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:15:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:15:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:15:43 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:15:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a419fcb8-aa62-4777-9815-8e9b17d2645e 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:43 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a419fcb8-aa62-4777-9815-8e9b17d2645e 1073741824 Jun 02 16:15:43 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:43 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9cde4779-72e2-4f64-9588-7b5d6e9c1c86 tempest-GroupSnapshotsTest-1776319603 None] group_snapshot 0f6b6924-4cee-4433-a37b-d0d0b6841759: created successfully Jun 02 16:15:44 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a419fcb8-aa62-4777-9815-8e9b17d2645e 1073741824" returned: 0 in 1.129s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a419fcb8-aa62-4777-9815-8e9b17d2645e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:44 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a419fcb8-aa62-4777-9815-8e9b17d2645e Jun 02 16:15:44 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:45 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a419fcb8-aa62-4777-9815-8e9b17d2645e" returned: 0 in 0.782s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.022s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "cinder-quobyte-56540445-fb74-487b-b6e7-6b3189a0c661-df8f3051-c609-4848-98f9-e92514b3bb52" by "_create_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2714de5d-98b8-4b5a-a849-b1a7c8bf6fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a419fcb8-aa62-4777-9815-8e9b17d2645e', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a221a595-b51c-4ea5-a150-a9cd469b6c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-56540445-fb74-487b-b6e7-6b3189a0c661-df8f3051-c609-4848-98f9-e92514b3bb52" acquired by "_create_volume_from_snapshot" :: waited 0.064s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Creating volume df8f3051-c609-4848-98f9-e92514b3bb52 from snapshot 56540445-fb74-487b-b6e7-6b3189a0c661 {{(pid=86488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "cinder-quobyte-df8f3051-c609-4848-98f9-e92514b3bb52" by "_copy_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:45 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Volume volume-a419fcb8-aa62-4777-9815-8e9b17d2645e (a419fcb8-aa62-4777-9815-8e9b17d2645e): created successfully Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a221a595-b51c-4ea5-a150-a9cd469b6c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Flow 'volume_create_manager' (5fb676bc-3bcc-40cb-8166-d8c81068cc97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-df8f3051-c609-4848-98f9-e92514b3bb52" acquired by "_copy_volume_from_snapshot" :: waited 0.096s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] snapshot: 56540445-fb74-487b-b6e7-6b3189a0c661, volume: df8f3051-c609-4848-98f9-e92514b3bb52, {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 16:15:45 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-7e496acf-b22a-4fa3-a6fb-8a650b54af68 tempest-VolumeTypesAccessTest-893313328 None] Created volume successfully. Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f39a57-57cb-492b-8fe7-a91098cafa0c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:15:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:45 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661 Jun 02 16:15:45 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Acquiring lock "cinder-a419fcb8-aa62-4777-9815-8e9b17d2645e-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Lock "cinder-a419fcb8-aa62-4777-9815-8e9b17d2645e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Acquiring lock "cinder-quobyte-a419fcb8-aa62-4777-9815-8e9b17d2645e" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Lock "cinder-quobyte-a419fcb8-aa62-4777-9815-8e9b17d2645e" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:46 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a69e244-e1fa-451a-a46a-ea94a2816dd2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:15:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a419fcb8-aa62-4777-9815-8e9b17d2645e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:46 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a419fcb8-aa62-4777-9815-8e9b17d2645e Jun 02 16:15:46 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:46 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661" returned: 0 in 0.777s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7841e6f-83d5-4bbd-a391-5d618418893a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:15:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 16:15:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Creating direct copy from snapshot {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 16:15:46 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54a501a-37b8-45b7-ac8e-e37084f99f50]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:15:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:46 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a Jun 02 16:15:46 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:47 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a419fcb8-aa62-4777-9815-8e9b17d2645e" returned: 0 in 0.761s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a419fcb8-aa62-4777-9815-8e9b17d2645e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:47 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a419fcb8-aa62-4777-9815-8e9b17d2645e Jun 02 16:15:47 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:47 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a" returned: 0 in 0.910s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:47 devstack cinder-volume[86488]: DEBUG cinder.utils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Path /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-df8f3051-c609-4848-98f9-e92514b3bb52 not found in is_blk_device check {{(pid=86488) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 16:15:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-df8f3051-c609-4848-98f9-e92514b3bb52 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:47 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-df8f3051-c609-4848-98f9-e92514b3bb52 Jun 02 16:15:47 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:48 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a419fcb8-aa62-4777-9815-8e9b17d2645e" returned: 0 in 0.980s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Lock "cinder-quobyte-a419fcb8-aa62-4777-9815-8e9b17d2645e" released by "delete_volume" :: held 1.805s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:15:48 devstack cinder-volume[86488]: WARNING cinder.quota [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-126435589 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-126435589, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:15:48 devstack cinder-volume[86488]: WARNING cinder.quota [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-126435589 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-126435589, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:15:48 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Created reservations ['103cbe77-536d-4742-8833-958b72cf8adc', 'c4cfcf83-c510-4b22-8027-6844b5328993', '27a3ad14-6745-46c3-aa48-34f5d6f5bea9', 'bd5603e7-be60-4b08-89c5-f7ceb2a74d28'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:15:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:15:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:15:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:48 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:15:48 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:49 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.505s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:49 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:15:49 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Deleted volume successfully. Jun 02 16:15:49 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a88ffe43-43ba-489d-aa7a-664fde4f1d33 tempest-VolumeTypesAccessTest-893313328 None] Lock "cinder-a419fcb8-aa62-4777-9815-8e9b17d2645e-delete_volume" released by "delete_volume" :: held 3.653s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:15:54 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-df8f3051-c609-4848-98f9-e92514b3bb52" returned: 0 in 6.845s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:54 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[50645a91-4c45-44b1-925f-ff72f9f2c20d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:15:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:54 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a Jun 02 16:15:54 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:55 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a" returned: 0 in 1.133s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:55 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Image conversion details: src /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-df8f3051-c609-4848-98f9-e92514b3bb52 {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:15:55 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Converted 1024.00 MB image at 149.57 MB/s Jun 02 16:15:55 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-df8f3051-c609-4848-98f9-e92514b3bb52 is being set with open permissions: ugo+rw: NotImplementedError Jun 02 16:15:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-df8f3051-c609-4848-98f9-e92514b3bb52 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:55 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-df8f3051-c609-4848-98f9-e92514b3bb52 Jun 02 16:15:55 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:56 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-df8f3051-c609-4848-98f9-e92514b3bb52" returned: 0 in 0.891s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:56 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-df8f3051-c609-4848-98f9-e92514b3bb52" released by "_copy_volume_from_snapshot" :: held 10.697s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:15:56 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-56540445-fb74-487b-b6e7-6b3189a0c661-df8f3051-c609-4848-98f9-e92514b3bb52" released by "_create_volume_from_snapshot" :: held 10.818s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:15:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.883s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:56 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-c519561a-231a-41ac-8ac8-d8cd1701a143 tempest-GroupSnapshotsTest-1776319603 None] Create group from source-snapshot-0f6b6924-4cee-4433-a37b-d0d0b6841759 completed successfully. Jun 02 16:15:57 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "cinder-quobyte-df8f3051-c609-4848-98f9-e92514b3bb52" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:57 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-df8f3051-c609-4848-98f9-e92514b3bb52" acquired by "delete_volume" :: waited 0.019s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:57 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d528b9b-5a18-4425-93cc-79990d890dcc]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:15:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-df8f3051-c609-4848-98f9-e92514b3bb52 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:57 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-df8f3051-c609-4848-98f9-e92514b3bb52 Jun 02 16:15:57 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:58 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-df8f3051-c609-4848-98f9-e92514b3bb52" returned: 0 in 0.932s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-df8f3051-c609-4848-98f9-e92514b3bb52 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:58 devstack sudo[96045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-df8f3051-c609-4848-98f9-e92514b3bb52 Jun 02 16:15:58 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:58 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root Jun 02 16:15:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-df8f3051-c609-4848-98f9-e92514b3bb52" returned: 0 in 0.795s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:15:58 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-df8f3051-c609-4848-98f9-e92514b3bb52" released by "delete_volume" :: held 1.796s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:15:58 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] Created reservations ['0ff2e854-9b8b-422b-9e72-f458ab29605a'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:15:58 devstack cinder-volume[86488]: WARNING cinder.quota [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2071193713 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2071193713, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:15:58 devstack cinder-volume[86488]: WARNING cinder.quota [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2071193713 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2071193713, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:15:59 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] Created reservations ['d5968be7-1dfa-4c36-9f3d-3cdbef5b4ee1', '68a22e94-e1d3-4b94-bfe5-83ac1e0f6f21', '4ec68592-87c2-418f-83e5-42a00f14a461', '99d11d4e-bc78-42e6-9954-ab75fd3f0376'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:15:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:15:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:15:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:15:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:15:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:15:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:15:59 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:15:59 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:15:59 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] group_snapshot 0f6b6924-4cee-4433-a37b-d0d0b6841759: deleting Jun 02 16:15:59 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:UPDATE=80,cinder:SELECT=73,cinder:INSERT=17,cinder:DELETE=7 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:15:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] group_snapshot 0f6b6924-4cee-4433-a37b-d0d0b6841759: deleting {{(pid=86488) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 02 16:15:59 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "cinder-quobyte-b7841e6f-83d5-4bbd-a391-5d618418893a" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:59 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-b7841e6f-83d5-4bbd-a391-5d618418893a" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:15:59 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "cinder-quobyte-56540445-fb74-487b-b6e7-6b3189a0c661" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:15:59 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-56540445-fb74-487b-b6e7-6b3189a0c661" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] Deleting offline snapshot 56540445-fb74-487b-b6e7-6b3189a0c661 of volume b7841e6f-83d5-4bbd-a391-5d618418893a {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:16:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] snapshot_file for this snap is: volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:16:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:16:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:16:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:16:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:00 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[17239a6f-a81b-46e5-9d40-878801c32fa3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:00 devstack sudo[96107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:16:00 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:00 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661 Jun 02 16:16:00 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:00 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.202s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:00 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:16:00 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9f5477dc-0528-4690-9598-5e1b6b4a5824 tempest-GroupSnapshotsTest-1776319603 None] Delete group completed successfully. Jun 02 16:16:01 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661" returned: 0 in 1.244s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7841e6f-83d5-4bbd-a391-5d618418893a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:16:01 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c7b740-a567-48fd-a01c-007741689b59]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:01 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.516s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:01 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:16:01 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a Jun 02 16:16:01 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:02 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:16:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Flow 'volume_create_manager' (04b83578-2b5a-4cb5-9add-6273b4e2c9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:16:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ff18ae-e5c7-4edb-942b-2ff08ae96b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:02 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a" returned: 0 in 1.214s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ff18ae-e5c7-4edb-942b-2ff08ae96b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-998491157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9b3ce4-c506-40e2-b3dd-109ef33ff592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364308e4394a47ba87fc4a598eb8482b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:16:03Z,use_quota=True,user_id='026a409b8fb04e3b968bb2b63dbf812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3fd3a2-ab13-4a9a-a98c-fcdf68378d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:02 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661 Jun 02 16:16:02 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3fd3a2-ab13-4a9a-a98c-fcdf68378d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04838ea-3320-499e-b3f6-8b941c54e65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:02 devstack cinder-volume[86488]: DEBUG cinder.image.glance [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Creating Keystone auth plugin from conf {{(pid=86488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 16:16:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04838ea-3320-499e-b3f6-8b941c54e65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aa9b3ce4-c506-40e2-b3dd-109ef33ff592', 'volume_name': 'volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592', 'volume_size': 1, 'image_id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '802a1494b5514d5c94e7154c7dda716e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'created_at': datetime.datetime(2026, 6, 2, 14, 3, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 3, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32db0a85-2b87-4b7a-81e5-6d624896685c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32db0a85-2b87-4b7a-81e5-6d624896685c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16193d22-8e37-4803-8237-fc35d081e112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:03 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Volume aa9b3ce4-c506-40e2-b3dd-109ef33ff592: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592', 'volume_size': 1, 'image_id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '802a1494b5514d5c94e7154c7dda716e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'created_at': datetime.datetime(2026, 6, 2, 14, 3, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 3, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 02 16:16:03 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Trying to clone aa9b3ce4-c506-40e2-b3dd-109ef33ff592 from image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}]). {{(pid=86488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 02 16:16:03 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661" returned: 0 in 1.190s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:03 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661 Jun 02 16:16:03 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:04 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_81khn98udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 16:16:04 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Image download 20.69 MB at 20.69 MB/s Jun 02 16:16:04 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a2d055-3ea9-4ce4-a711-b6b21b0e88b1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_81khn98udevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:04 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_81khn98udevstack@QuobyteHD Jun 02 16:16:04 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:04 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a.56540445-fb74-487b-b6e7-6b3189a0c661" returned: 0 in 0.941s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:04 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-56540445-fb74-487b-b6e7-6b3189a0c661" released by "_delete_snapshot" :: held 4.871s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:04 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-b7841e6f-83d5-4bbd-a391-5d618418893a" released by "delete_snapshot" :: held 4.950s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:04 devstack cinder-volume[86488]: WARNING cinder.quota [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2071193713 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2071193713, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:16:05 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] Created reservations ['fab3a12e-0ba3-4214-a0dd-09a31c2563e0', 'b1b3297a-946e-4c92-aa80-6a4beaa81daa', '336ec493-fa6c-408b-88cd-b0e2e9149f33', 'd3023e2c-989c-498c-b3c2-99f52182fd3e'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:16:05 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_81khn98udevstack@QuobyteHD" returned: 0 in 0.924s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:05 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Temporary image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 is fetched for user 026a409b8fb04e3b968bb2b63dbf812e. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 16:16:05 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-15ea4cb7-07d3-4040-988d-33a8512f74b1 tempest-GroupSnapshotsTest-1776319603 None] group_snapshot 0f6b6924-4cee-4433-a37b-d0d0b6841759: deleted successfully Jun 02 16:16:05 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[73608dc5-bf26-465c-863c-f15acaf7698b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_81khn98udevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:05 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_81khn98udevstack@QuobyteHD Jun 02 16:16:05 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "cinder-quobyte-b7841e6f-83d5-4bbd-a391-5d618418893a" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:16:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-b7841e6f-83d5-4bbd-a391-5d618418893a" acquired by "delete_volume" :: waited 0.058s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:05 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d11dfd-4d27-4982-8ba6-fd8419a291ca]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:05 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_81khn98udevstack@QuobyteHD" returned: 0 in 0.817s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:05 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-998491157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9b3ce4-c506-40e2-b3dd-109ef33ff592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364308e4394a47ba87fc4a598eb8482b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:16:03Z,use_quota=True,user_id='026a409b8fb04e3b968bb2b63dbf812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:16:05 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Creating volume aa9b3ce4-c506-40e2-b3dd-109ef33ff592 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:16:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:05 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:16:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:16:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:16:06 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:16:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:06 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 1073741824 Jun 02 16:16:06 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:06 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a Jun 02 16:16:06 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:06 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a" returned: 0 in 0.934s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:06 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a Jun 02 16:16:06 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:07 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 1073741824" returned: 0 in 1.074s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:07 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 Jun 02 16:16:07 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:07 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b7841e6f-83d5-4bbd-a391-5d618418893a" returned: 0 in 0.799s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-b7841e6f-83d5-4bbd-a391-5d618418893a" released by "delete_volume" :: held 1.873s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:07 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] Created reservations ['ca748b5d-94d2-4562-a5d3-d82cbc5661df'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:16:07 devstack cinder-volume[86488]: WARNING cinder.db.sqlalchemy.api [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2071193713'] Jun 02 16:16:07 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] Created reservations ['aaa4750e-594e-4c5b-89f3-87e95996fd6d', 'c29727a0-6e1e-456a-9b01-b7ae5205215a', 'd1f86b50-eb20-4ba4-b687-a880a99b6a4e', '0edafab3-a60d-4f83-aa38-0be334e279e5'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:16:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:16:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:16:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:08 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:16:08 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:08 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592" returned: 0 in 1.080s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:16:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.222s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:08 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Attempting download of d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}])) to volume aa9b3ce4-c506-40e2-b3dd-109ef33ff592. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 16:16:08 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb8a708-72c0-4ce0-9a34-1eb3b1f890b9]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_zc7u77_n {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:08 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_zc7u77_n Jun 02 16:16:08 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:09 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-1135c365-7e17-4b49-967b-3f610c3b7bae tempest-GroupSnapshotsTest-1776319603 None] Group tempest-GroupSnapshotsTest-Group-215609522: creating Jun 02 16:16:09 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-1135c365-7e17-4b49-967b-3f610c3b7bae tempest-GroupSnapshotsTest-1776319603 None] Group tempest-GroupSnapshotsTest-Group-215609522: created successfully Jun 02 16:16:09 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-1135c365-7e17-4b49-967b-3f610c3b7bae tempest-GroupSnapshotsTest-1776319603 None] Create group completed successfully. Jun 02 16:16:09 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.076s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:09 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:16:09 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f8ddf804-cc9f-45bf-8262-5fd92b15c684 tempest-GroupSnapshotsTest-1776319603 None] Delete group completed successfully. Jun 02 16:16:09 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_zc7u77_n" returned: 0 in 1.211s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_zc7u77_n {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:09 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_zc7u77_n Jun 02 16:16:09 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:10 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_zc7u77_n" returned: 1 in 1.065s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_zc7u77_n' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[156e2549-e5e1-4425-a132-349f36e1923a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_81khn98udevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Flow 'volume_create_manager' (7ef47adb-7b30-4a33-830c-4c85edb2ae58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298f5956-2c40-4245-956a-e40f75fc9587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298f5956-2c40-4245-956a-e40f75fc9587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-392141550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b20b3120-008d-4aa8-a58d-c01879aa8228,host='devstack@QuobyteHD#QuobyteHD',id=cdd4a97a-0c4e-4a6d-b5b7-41795eb90653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8687de7ed5a44b4fa1653b86ff51bebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:16:11Z,use_quota=True,user_id='b0e2967420ab4f6282af354d4b206ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d8c79ce-ceb4-4270-b450-30ea0f4a6f58),volume_type_id=9d8c79ce-ceb4-4270-b450-30ea0f4a6f58)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132228f5-ab4e-43b9-8d4b-6a51293778a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:10 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_81khn98udevstack@QuobyteHD Jun 02 16:16:10 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132228f5-ab4e-43b9-8d4b-6a51293778a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c8875d-3dad-4e44-b3e2-a41b24a2dc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c8875d-3dad-4e44-b3e2-a41b24a2dc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdd4a97a-0c4e-4a6d-b5b7-41795eb90653', 'volume_name': 'volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5956ec2-a043-4bff-a107-1f13b1a14680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5956ec2-a043-4bff-a107-1f13b1a14680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e44160-ab86-4232-8389-c76a7dc1095d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:10 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Volume cdd4a97a-0c4e-4a6d-b5b7-41795eb90653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653', 'volume_size': 1} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b20b3120-008d-4aa8-a58d-c01879aa8228,created_at=2026-06-02T14:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-392141550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b20b3120-008d-4aa8-a58d-c01879aa8228,host='devstack@QuobyteHD#QuobyteHD',id=cdd4a97a-0c4e-4a6d-b5b7-41795eb90653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8687de7ed5a44b4fa1653b86ff51bebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:16:11Z,use_quota=True,user_id='b0e2967420ab4f6282af354d4b206ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d8c79ce-ceb4-4270-b450-30ea0f4a6f58),volume_type_id=9d8c79ce-ceb4-4270-b450-30ea0f4a6f58)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Creating volume cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:16:10 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:16:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:11 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 1073741824 Jun 02 16:16:11 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:11 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_81khn98udevstack@QuobyteHD" returned: 0 in 1.029s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:11 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 was qcow2, converting to raw {{(pid=86488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 16:16:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_81khn98udevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:11 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_81khn98udevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 Jun 02 16:16:11 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:12 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 1073741824" returned: 0 in 1.197s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:12 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 Jun 02 16:16:12 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:13 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653" returned: 0 in 0.799s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:16:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:13 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e44160-ab86-4232-8389-c76a7dc1095d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:13 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25e4526-5ceb-4c13-9704-fefa65bace2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:13 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Volume volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 (cdd4a97a-0c4e-4a6d-b5b7-41795eb90653): created successfully Jun 02 16:16:13 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25e4526-5ceb-4c13-9704-fefa65bace2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:13 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Flow 'volume_create_manager' (7ef47adb-7b30-4a33-830c-4c85edb2ae58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:16:13 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9a14ed97-e532-4207-a40f-2e3962b51cce tempest-GroupSnapshotsTest-1776319603 None] Created volume successfully. Jun 02 16:16:14 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_81khn98udevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592" returned: 0 in 2.622s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_81khn98udevstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:16:14 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Converted 112.00 MB image at 42.62 MB/s Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:14 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 1G Jun 02 16:16:14 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Flow 'volume_create_manager' (459f68fd-b71d-4de1-b421-1f60cf91736a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5419b41-f4f4-424f-a09d-ef093a5a70bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5419b41-f4f4-424f-a09d-ef093a5a70bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1943483385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b20b3120-008d-4aa8-a58d-c01879aa8228,host='devstack@QuobyteHD#QuobyteHD',id=2c28575b-157d-42cc-8942-fb74d2fac4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8687de7ed5a44b4fa1653b86ff51bebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:16:15Z,use_quota=True,user_id='b0e2967420ab4f6282af354d4b206ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d8c79ce-ceb4-4270-b450-30ea0f4a6f58),volume_type_id=9d8c79ce-ceb4-4270-b450-30ea0f4a6f58)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fb6d70-7ddc-4f92-a9d7-1a87937bd91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fb6d70-7ddc-4f92-a9d7-1a87937bd91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2235ff-4d15-40fa-a9ad-2eb47b805e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2235ff-4d15-40fa-a9ad-2eb47b805e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c28575b-157d-42cc-8942-fb74d2fac4d2', 'volume_name': 'volume-2c28575b-157d-42cc-8942-fb74d2fac4d2', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563bd297-c314-4121-af39-0679196a6923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563bd297-c314-4121-af39-0679196a6923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf0e8d6-aaa8-49b9-a854-8f739f6c5413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:14 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Volume 2c28575b-157d-42cc-8942-fb74d2fac4d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c28575b-157d-42cc-8942-fb74d2fac4d2', 'volume_size': 1} Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b20b3120-008d-4aa8-a58d-c01879aa8228,created_at=2026-06-02T14:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1943483385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b20b3120-008d-4aa8-a58d-c01879aa8228,host='devstack@QuobyteHD#QuobyteHD',id=2c28575b-157d-42cc-8942-fb74d2fac4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8687de7ed5a44b4fa1653b86ff51bebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:16:15Z,use_quota=True,user_id='b0e2967420ab4f6282af354d4b206ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d8c79ce-ceb4-4270-b450-30ea0f4a6f58),volume_type_id=9d8c79ce-ceb4-4270-b450-30ea0f4a6f58)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:16:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Creating volume 2c28575b-157d-42cc-8942-fb74d2fac4d2 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:16:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:15 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:16:15 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:16:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:15 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:16:15 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:16:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:15 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2 1073741824 Jun 02 16:16:15 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:15 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 1G" returned: 0 in 0.779s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:15 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9d3450-e519-4f1c-8b5b-ee6a5b5e2d0c]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:15 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 Jun 02 16:16:15 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:15 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2 1073741824" returned: 0 in 0.971s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:16 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2 Jun 02 16:16:16 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:16 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592" returned: 0 in 1.016s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:16 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 Jun 02 16:16:16 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:16 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2" returned: 0 in 0.744s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:16:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf0e8d6-aaa8-49b9-a854-8f739f6c5413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c28575b-157d-42cc-8942-fb74d2fac4d2', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49df2dea-e793-4f54-9706-0e7a3625b8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:16 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Volume volume-2c28575b-157d-42cc-8942-fb74d2fac4d2 (2c28575b-157d-42cc-8942-fb74d2fac4d2): created successfully Jun 02 16:16:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49df2dea-e793-4f54-9706-0e7a3625b8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Flow 'volume_create_manager' (459f68fd-b71d-4de1-b421-1f60cf91736a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:16:16 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f0a4e9da-0ba1-4743-a4c5-f3c7f20e62a5 tempest-GroupSnapshotsTest-1776319603 None] Created volume successfully. Jun 02 16:16:17 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592" returned: 1 in 0.834s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:16:17 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Downloaded image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}])) to volume aa9b3ce4-c506-40e2-b3dd-109ef33ff592 successfully. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 16:16:17 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Temporary image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 for user 026a409b8fb04e3b968bb2b63dbf812e is deleted. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 16:16:17 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Marking volume aa9b3ce4-c506-40e2-b3dd-109ef33ff592 as bootable. {{(pid=86488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 16:16:17 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Copying metadata from image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 to aa9b3ce4-c506-40e2-b3dd-109ef33ff592. {{(pid=86488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 16:16:17 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Creating volume glance metadata for volume aa9b3ce4-c506-40e2-b3dd-109ef33ff592 backed by image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 16:16:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16193d22-8e37-4803-8237-fc35d081e112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592', 'volume_size': 1, 'image_id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '802a1494b5514d5c94e7154c7dda716e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'created_at': datetime.datetime(2026, 6, 2, 14, 3, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 3, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1624ebc8-b76f-4d63-910f-e75e3747277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:17 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Volume volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 (aa9b3ce4-c506-40e2-b3dd-109ef33ff592): created successfully Jun 02 16:16:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1624ebc8-b76f-4d63-910f-e75e3747277f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Flow 'volume_create_manager' (04b83578-2b5a-4cb5-9add-6273b4e2c9db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:16:17 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-12100e47-2bd9-4680-8a8e-6bb2d6aa7cc1 tempest-VolumesImageMetadata-236610512 None] Created volume successfully. Jun 02 16:16:17 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-fb0e4d16-84e6-4175-8d58-a012e6ced441 tempest-GroupSnapshotsTest-1776319603 None] Update group completed successfully. Jun 02 16:16:18 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-c68c24c6-7a60-47df-bdb0-ba71009c1b57 tempest-GroupSnapshotsTest-1776319603 None] Update group completed successfully. Jun 02 16:16:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Acquiring lock "cinder-aa9b3ce4-c506-40e2-b3dd-109ef33ff592-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:16:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Lock "cinder-aa9b3ce4-c506-40e2-b3dd-109ef33ff592-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Acquiring lock "cinder-quobyte-aa9b3ce4-c506-40e2-b3dd-109ef33ff592" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:16:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Lock "cinder-quobyte-aa9b3ce4-c506-40e2-b3dd-109ef33ff592" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:18 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6af322-db83-499b-b4e6-690bca417c9b]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:18 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 Jun 02 16:16:18 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:19 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592" returned: 0 in 0.758s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:19 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 Jun 02 16:16:19 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:19 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-aa3f85d1-d1e3-4ecc-abd2-fea844cfb93c tempest-GroupSnapshotsTest-1776319603 None] Update group completed successfully. Jun 02 16:16:20 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592" returned: 1 in 0.941s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:16:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:20 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592 Jun 02 16:16:20 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:20 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-c54079e8-8ad5-4c25-a754-d6535fcfc4f7 tempest-GroupSnapshotsTest-1776319603 None] Update group completed successfully. Jun 02 16:16:21 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aa9b3ce4-c506-40e2-b3dd-109ef33ff592" returned: 0 in 0.685s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:21 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Lock "cinder-quobyte-aa9b3ce4-c506-40e2-b3dd-109ef33ff592" released by "delete_volume" :: held 2.466s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:21 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Created reservations ['ee4bffbe-ec85-4782-926e-b6ced7c2b676', '1eaf83da-f619-439e-8941-e40e5bc66481', '621cc23f-5edc-4809-9866-300f671a468f', '1d7c9407-6201-4b56-b5d6-724e617aba81'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:16:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:16:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:16:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:21 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:16:21 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:21 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.600s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:21 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:16:21 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Deleted volume successfully. Jun 02 16:16:21 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-211392ec-8400-4061-8a75-d8e4fea43766 tempest-VolumesImageMetadata-236610512 None] Lock "cinder-aa9b3ce4-c506-40e2-b3dd-109ef33ff592-delete_volume" released by "delete_volume" :: held 3.327s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:22 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] GroupSnapshot 83cd3816-685b-4851-90ec-ddf61c251fe6: creating. Jun 02 16:16:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Group snapshot 83cd3816-685b-4851-90ec-ddf61c251fe6: creating. {{(pid=86488) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 02 16:16:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Creating offline snapshot 8844639d-49bd-418a-8c0d-d8c1558f5ead of volume cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:16:22 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffe17b4-548d-423b-8d6c-f17c848eae43]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:22 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 Jun 02 16:16:22 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:23 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653" returned: 0 in 0.951s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:23 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead 1G Jun 02 16:16:23 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:24 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead 1G" returned: 0 in 1.441s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:24 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead Jun 02 16:16:24 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:26 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead" returned: 0 in 1.213s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:26 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead is being set with open permissions: ugo+rw: NotImplementedError Jun 02 16:16:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:26 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead Jun 02 16:16:26 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:26 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead" returned: 0 in 0.814s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:27 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.info Jun 02 16:16:27 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:27 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.info" returned: 0 in 0.909s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:27 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 16:16:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:27 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.info Jun 02 16:16:27 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Flow 'volume_create_manager' (2e8ea137-9294-481b-8c4b-b0a278057527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a06256-0eac-4641-97fe-5b67b949faae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a06256-0eac-4641-97fe-5b67b949faae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1497096830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f28c895-f614-4985-8f7b-c0010a5e32e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b0677d3bcb425eadd821c21c67cbfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:16:28Z,use_quota=True,user_id='39de5ec436964ffcb442e2a872fd5abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef15417-f3b9-47c9-83d2-1fde454131f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef15417-f3b9-47c9-83d2-1fde454131f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc53907-ae27-4b03-9dc9-2ee91582da82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc53907-ae27-4b03-9dc9-2ee91582da82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f28c895-f614-4985-8f7b-c0010a5e32e3', 'volume_name': 'volume-7f28c895-f614-4985-8f7b-c0010a5e32e3', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e4d41d7-41c1-4e4c-9386-7b5b61388b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e4d41d7-41c1-4e4c-9386-7b5b61388b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c0bdcf6-9695-4197-8c45-b5d1fb3f2801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:28 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Volume 7f28c895-f614-4985-8f7b-c0010a5e32e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f28c895-f614-4985-8f7b-c0010a5e32e3', 'volume_size': 1} Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:28 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.info" returned: 0 in 0.632s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.083s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Creating offline snapshot 99108f4f-7972-4875-bfc4-796abd5f66b8 of volume 2c28575b-157d-42cc-8942-fb74d2fac4d2 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b331cf-a98a-4c83-a232-1ae1c280ffc9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:28 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2 Jun 02 16:16:28 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:29 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2" returned: 0 in 0.835s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:29 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8 1G Jun 02 16:16:29 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:30 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8 1G" returned: 0 in 0.823s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c28575b-157d-42cc-8942-fb74d2fac4d2 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:30 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c28575b-157d-42cc-8942-fb74d2fac4d2 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8 Jun 02 16:16:30 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:30 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c28575b-157d-42cc-8942-fb74d2fac4d2 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8" returned: 0 in 0.654s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:30 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8 is being set with open permissions: ugo+rw: NotImplementedError Jun 02 16:16:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:30 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8 Jun 02 16:16:30 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8" returned: 0 in 0.648s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:31 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:31 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.info Jun 02 16:16:31 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] Acquiring lock "cinder-63104a7d-0817-4529-9975-db6fe4ad2618-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:16:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "cinder-63104a7d-0817-4529-9975-db6fe4ad2618-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:31 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=98,cinder:INSERT=27,cinder:UPDATE=90,cinder:DELETE=2 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:16:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] Acquiring lock "cinder-quobyte-63104a7d-0817-4529-9975-db6fe4ad2618" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:16:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "cinder-quobyte-63104a7d-0817-4529-9975-db6fe4ad2618" acquired by "delete_volume" :: waited 0.043s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:32 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca07452e-07f5-4370-a815-742f5d8d5b2d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-63104a7d-0817-4529-9975-db6fe4ad2618 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:32 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-63104a7d-0817-4529-9975-db6fe4ad2618 Jun 02 16:16:32 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:32 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.info" returned: 0 in 0.930s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:32 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 16:16:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:32 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.info Jun 02 16:16:32 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:33 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-63104a7d-0817-4529-9975-db6fe4ad2618" returned: 0 in 1.404s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-63104a7d-0817-4529-9975-db6fe4ad2618 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:33 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-63104a7d-0817-4529-9975-db6fe4ad2618 Jun 02 16:16:33 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:33 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.info" returned: 0 in 1.325s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.335s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.628s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:33 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1497096830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f28c895-f614-4985-8f7b-c0010a5e32e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b0677d3bcb425eadd821c21c67cbfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:16:28Z,use_quota=True,user_id='39de5ec436964ffcb442e2a872fd5abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:16:33 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Creating volume 7f28c895-f614-4985-8f7b-c0010a5e32e3 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:16:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:33 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:16:33 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:16:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:33 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:16:33 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:16:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f28c895-f614-4985-8f7b-c0010a5e32e3 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:34 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f28c895-f614-4985-8f7b-c0010a5e32e3 1073741824 Jun 02 16:16:34 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:34 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-920b8457-28e9-4d47-857d-5c8d65b0145f tempest-GroupSnapshotsTest-1776319603 None] group_snapshot 83cd3816-685b-4851-90ec-ddf61c251fe6: created successfully Jun 02 16:16:34 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:34 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] group_snapshot 83cd3816-685b-4851-90ec-ddf61c251fe6: deleting Jun 02 16:16:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-63104a7d-0817-4529-9975-db6fe4ad2618" returned: 0 in 1.249s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "cinder-quobyte-63104a7d-0817-4529-9975-db6fe4ad2618" released by "delete_volume" :: held 2.779s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] group_snapshot 83cd3816-685b-4851-90ec-ddf61c251fe6: deleting {{(pid=86488) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 02 16:16:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "cinder-quobyte-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:16:34 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] Created reservations ['2530cd45-2b83-4e94-b322-8a837fa6fda8', 'c4b5345a-d247-476d-bc98-288a2d8ddcea', '88e54a9d-657d-489c-b2f8-314df9098f5c', '96c34e0a-a8d7-4de4-8228-a9c955621f03'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:16:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "cinder-quobyte-8844639d-49bd-418a-8c0d-d8c1558f5ead" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:16:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-8844639d-49bd-418a-8c0d-d8c1558f5ead" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:35 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Deleting offline snapshot 8844639d-49bd-418a-8c0d-d8c1558f5ead of volume cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:16:35 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] snapshot_file for this snap is: volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:16:35 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede65fd3-156c-4680-bb01-8380dcfc5e28]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:35 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:16:35 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:16:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:35 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:16:35 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:35 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead Jun 02 16:16:35 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] Acquiring lock "cinder-1a6f1b5d-2f3c-441a-9c78-e154109e97f6-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:16:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "cinder-1a6f1b5d-2f3c-441a-9c78-e154109e97f6-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:36 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f28c895-f614-4985-8f7b-c0010a5e32e3 1073741824" returned: 0 in 2.336s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] Acquiring lock "cinder-quobyte-1a6f1b5d-2f3c-441a-9c78-e154109e97f6" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:16:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "cinder-quobyte-1a6f1b5d-2f3c-441a-9c78-e154109e97f6" acquired by "delete_volume" :: waited 0.096s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f28c895-f614-4985-8f7b-c0010a5e32e3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:36 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[36db2122-48f5-48fd-9b64-1b6e272623ec]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:36 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.316s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:36 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:16:36 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] Deleted volume successfully. Jun 02 16:16:36 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f28c895-f614-4985-8f7b-c0010a5e32e3 Jun 02 16:16:36 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e8c8117c-3f69-4327-965c-017fa60815f1 tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "cinder-63104a7d-0817-4529-9975-db6fe4ad2618-delete_volume" released by "delete_volume" :: held 4.670s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:36 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6 Jun 02 16:16:36 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:36 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead" returned: 0 in 1.883s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:16:37 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc036a2f-a977-44f7-a858-1b2f29ff9af8]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:37 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 Jun 02 16:16:37 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:37 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f28c895-f614-4985-8f7b-c0010a5e32e3" returned: 0 in 1.187s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:37 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] <== create_volume: return (3757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:16:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.776s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c0bdcf6-9695-4197-8c45-b5d1fb3f2801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f28c895-f614-4985-8f7b-c0010a5e32e3', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4d4d19-4deb-4770-8390-0e221d5eb5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:37 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Volume volume-7f28c895-f614-4985-8f7b-c0010a5e32e3 (7f28c895-f614-4985-8f7b-c0010a5e32e3): created successfully Jun 02 16:16:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4d4d19-4deb-4770-8390-0e221d5eb5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Flow 'volume_create_manager' (2e8ea137-9294-481b-8c4b-b0a278057527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:16:37 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-17beba0b-cbfa-4726-b6c8-ec1e9eacfc41 tempest-AbsoluteLimitsTests-1804991882 None] Created volume successfully. Jun 02 16:16:38 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6" returned: 0 in 1.559s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:38 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6 Jun 02 16:16:38 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:38 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653" returned: 0 in 1.562s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:38 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead Jun 02 16:16:38 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:38 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] Acquiring lock "cinder-7f28c895-f614-4985-8f7b-c0010a5e32e3-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:16:38 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] Lock "cinder-7f28c895-f614-4985-8f7b-c0010a5e32e3-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:38 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] Acquiring lock "cinder-quobyte-7f28c895-f614-4985-8f7b-c0010a5e32e3" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:16:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] Lock "cinder-quobyte-7f28c895-f614-4985-8f7b-c0010a5e32e3" acquired by "delete_volume" :: waited 0.036s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:39 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1a32d1-7334-41a9-91dd-515c8163f92e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f28c895-f614-4985-8f7b-c0010a5e32e3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:39 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f28c895-f614-4985-8f7b-c0010a5e32e3 Jun 02 16:16:39 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:39 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1a6f1b5d-2f3c-441a-9c78-e154109e97f6" returned: 0 in 1.270s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "cinder-quobyte-1a6f1b5d-2f3c-441a-9c78-e154109e97f6" released by "delete_volume" :: held 2.950s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:39 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] Created reservations ['2af7d5aa-2915-474c-9803-bf7d3970ae2d', '484ac358-71b7-4bc3-93e8-30b5c25ea6a6', '59463cb9-ed92-43c0-ad67-5aee38fa16ab', '83b38f44-2686-4e46-9ef8-c5eb5ed7ff5d'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:16:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:39 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:16:39 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:16:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:39 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:16:39 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:40 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead" returned: 0 in 1.437s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:40 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead Jun 02 16:16:40 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:40 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f28c895-f614-4985-8f7b-c0010a5e32e3" returned: 0 in 1.808s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f28c895-f614-4985-8f7b-c0010a5e32e3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:40 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f28c895-f614-4985-8f7b-c0010a5e32e3 Jun 02 16:16:40 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:41 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.507s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:41 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:16:41 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] Deleted volume successfully. Jun 02 16:16:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ec6f25d4-9607-4dc0-bf2d-4adc56cef29f tempest-AttachVolumeShelveTestJSON-801041235 None] Lock "cinder-1a6f1b5d-2f3c-441a-9c78-e154109e97f6-delete_volume" released by "delete_volume" :: held 5.035s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:41 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653.8844639d-49bd-418a-8c0d-d8c1558f5ead" returned: 0 in 1.535s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-8844639d-49bd-418a-8c0d-d8c1558f5ead" released by "_delete_snapshot" :: held 6.619s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653" released by "delete_snapshot" :: held 6.686s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "cinder-quobyte-2c28575b-157d-42cc-8942-fb74d2fac4d2" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:16:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-2c28575b-157d-42cc-8942-fb74d2fac4d2" acquired by "delete_snapshot" :: waited 0.066s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "cinder-quobyte-99108f4f-7972-4875-bfc4-796abd5f66b8" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:16:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-99108f4f-7972-4875-bfc4-796abd5f66b8" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Deleting offline snapshot 99108f4f-7972-4875-bfc4-796abd5f66b8 of volume 2c28575b-157d-42cc-8942-fb74d2fac4d2 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:16:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] snapshot_file for this snap is: volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:16:41 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d407156-3e60-497b-b386-773cb877abcd]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:42 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8 Jun 02 16:16:42 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:42 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f28c895-f614-4985-8f7b-c0010a5e32e3" returned: 0 in 1.494s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] Lock "cinder-quobyte-7f28c895-f614-4985-8f7b-c0010a5e32e3" released by "delete_volume" :: held 3.399s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:42 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] Created reservations ['f4344ccb-1f55-475c-be49-9e3b3fd96b1d', '553a9042-c168-425b-b056-92ffda0f7d57', '7fb994ac-788c-49c6-b0f4-00b7dcf0e16f', '5ad6b568-5377-44cb-8aef-ba8ba08e5cf9'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:16:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:16:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:16:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:42 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:16:42 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:44 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8" returned: 0 in 2.114s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c28575b-157d-42cc-8942-fb74d2fac4d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:16:44 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bb50f0-fc89-4ca1-b784-b0d0ff023c9a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:44 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2 Jun 02 16:16:44 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:44 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.915s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:44 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:16:44 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] Deleted volume successfully. Jun 02 16:16:44 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-efcc8169-df28-47a0-8c76-c4e474f2aacb tempest-AbsoluteLimitsTests-1804991882 None] Lock "cinder-7f28c895-f614-4985-8f7b-c0010a5e32e3-delete_volume" released by "delete_volume" :: held 6.026s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:45 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2" returned: 0 in 1.730s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:45 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8 Jun 02 16:16:45 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:47 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8" returned: 0 in 1.150s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:47 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8 Jun 02 16:16:47 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:48 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2.99108f4f-7972-4875-bfc4-796abd5f66b8" returned: 0 in 0.986s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-99108f4f-7972-4875-bfc4-796abd5f66b8" released by "_delete_snapshot" :: held 6.224s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-2c28575b-157d-42cc-8942-fb74d2fac4d2" released by "delete_snapshot" :: held 6.306s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:48 devstack cinder-volume[86488]: WARNING cinder.quota [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-970774396 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-970774396, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:16:48 devstack cinder-volume[86488]: WARNING cinder.quota [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-970774396 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-970774396, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:16:48 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Created reservations ['16698898-95c7-4591-bd3b-33dbc21568a3', '9ca2efcd-b428-4cae-9f87-e55d2f1f6486', '193e544a-6c91-4bb8-a819-4d16eaf1f752', '24c252af-733c-44cc-a4cb-375b8190802c'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:16:48 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] Created reservations ['1b06976a-69fb-4e4c-bfa6-f730e18d56de', 'eeba3646-8a5f-4cf7-9679-e0f8a1c35411', 'd6386305-1123-4e62-9d51-8a7af02c143b', 'b960c4ec-5090-43bd-94f3-d6a064b5685b'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:16:48 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-64e145fe-3cb4-4304-a153-269ccc15b742 tempest-GroupSnapshotsTest-1776319603 None] group_snapshot 83cd3816-685b-4851-90ec-ddf61c251fe6: deleted successfully Jun 02 16:16:50 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "cinder-quobyte-2c28575b-157d-42cc-8942-fb74d2fac4d2" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:16:50 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-2c28575b-157d-42cc-8942-fb74d2fac4d2" acquired by "delete_volume" :: waited 0.036s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:50 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51da64e-22b6-4b8f-8dd9-797f3b68f0a4]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:50 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2 Jun 02 16:16:50 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Flow 'volume_create_manager' (f29618b0-5caa-4668-a793-e161eaa14cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ddbf64-2bb4-4625-bbaa-ecc712cddcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:51 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ddbf64-2bb4-4625-bbaa-ecc712cddcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1127668031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098be561-ebbe-4b23-9185-1504e6f8621e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb0d1a0f85742d3887ea1d6c2e4f799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:16:51Z,use_quota=True,user_id='938eca1335f84242a0607a391486e059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d6d148-ad92-4d69-bd5e-1e0553a9ceb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d6d148-ad92-4d69-bd5e-1e0553a9ceb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66828829-a176-443a-976d-bff36fa374ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66828829-a176-443a-976d-bff36fa374ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '098be561-ebbe-4b23-9185-1504e6f8621e', 'volume_name': 'volume-098be561-ebbe-4b23-9185-1504e6f8621e', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614883e2-3814-45c2-b3d4-0e93afcda89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614883e2-3814-45c2-b3d4-0e93afcda89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda8a36a-e8d1-41e6-a707-b0936730f52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:51 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Volume 098be561-ebbe-4b23-9185-1504e6f8621e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-098be561-ebbe-4b23-9185-1504e6f8621e', 'volume_size': 1} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1127668031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098be561-ebbe-4b23-9185-1504e6f8621e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb0d1a0f85742d3887ea1d6c2e4f799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:16:51Z,use_quota=True,user_id='938eca1335f84242a0607a391486e059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Creating volume 098be561-ebbe-4b23-9185-1504e6f8621e {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:16:51 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-098be561-ebbe-4b23-9185-1504e6f8621e 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2" returned: 0 in 1.125s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:51 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-098be561-ebbe-4b23-9185-1504e6f8621e 1073741824 Jun 02 16:16:51 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:51 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2 Jun 02 16:16:51 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:52 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c28575b-157d-42cc-8942-fb74d2fac4d2" returned: 0 in 1.348s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:52 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-098be561-ebbe-4b23-9185-1504e6f8621e 1073741824" returned: 0 in 1.411s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:52 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-2c28575b-157d-42cc-8942-fb74d2fac4d2" released by "delete_volume" :: held 2.626s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:52 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "cinder-quobyte-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653" acquired by "delete_volume" :: waited 0.045s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Flow 'volume_create_manager' (f67109c2-c8d3-44ec-995d-91f2f1407b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e995b85-5f2d-40cb-9b7d-3d4c4d6b21fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd7c4ae-4390-403f-a753-32c8c46afa47]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-098be561-ebbe-4b23-9185-1504e6f8621e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e995b85-5f2d-40cb-9b7d-3d4c4d6b21fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1584615620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c80f00-f57e-42f3-b436-4df1bb10c0a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669c1dbc047e45a9a2f92455af86c1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:16:53Z,use_quota=True,user_id='c4c363db24c348e7843304b7d0bf5f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:53 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-098be561-ebbe-4b23-9185-1504e6f8621e Jun 02 16:16:53 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f4f570-b28c-4207-b62f-5e52cf61383d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f4f570-b28c-4207-b62f-5e52cf61383d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2a4f89-52da-4da0-85c5-5816b2c995c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2a4f89-52da-4da0-85c5-5816b2c995c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c80f00-f57e-42f3-b436-4df1bb10c0a7', 'volume_name': 'volume-b9c80f00-f57e-42f3-b436-4df1bb10c0a7', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29f3684-48db-463d-9a85-53cfa2a39fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29f3684-48db-463d-9a85-53cfa2a39fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28010911-68e0-4f8d-96ec-bfe10febd059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:53 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Volume b9c80f00-f57e-42f3-b436-4df1bb10c0a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c80f00-f57e-42f3-b436-4df1bb10c0a7', 'volume_size': 1} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:53 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 Jun 02 16:16:53 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:53 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-331ed7c6-c43a-4617-9cdc-afea4cd186c7 tempest-GroupsV320Test-2128839358 None] Group tempest-GroupsV320Test-Group-619719033: creating Jun 02 16:16:53 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-331ed7c6-c43a-4617-9cdc-afea4cd186c7 tempest-GroupsV320Test-2128839358 None] Group tempest-GroupsV320Test-Group-619719033: created successfully Jun 02 16:16:53 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-331ed7c6-c43a-4617-9cdc-afea4cd186c7 tempest-GroupsV320Test-2128839358 None] Create group completed successfully. Jun 02 16:16:53 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-098be561-ebbe-4b23-9185-1504e6f8621e" returned: 0 in 0.781s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] <== create_volume: return (2358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.362s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.708s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1584615620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c80f00-f57e-42f3-b436-4df1bb10c0a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669c1dbc047e45a9a2f92455af86c1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:16:53Z,use_quota=True,user_id='c4c363db24c348e7843304b7d0bf5f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Creating volume b9c80f00-f57e-42f3-b436-4df1bb10c0a7 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:16:53 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9c80f00-f57e-42f3-b436-4df1bb10c0a7 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:53 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9c80f00-f57e-42f3-b436-4df1bb10c0a7 1073741824 Jun 02 16:16:53 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda8a36a-e8d1-41e6-a707-b0936730f52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-098be561-ebbe-4b23-9185-1504e6f8621e', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06f257b-b25b-46d0-aba6-5a253b3a816d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:53 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Volume volume-098be561-ebbe-4b23-9185-1504e6f8621e (098be561-ebbe-4b23-9185-1504e6f8621e): created successfully Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06f257b-b25b-46d0-aba6-5a253b3a816d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Flow 'volume_create_manager' (f29618b0-5caa-4668-a793-e161eaa14cde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:16:54 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-17b76444-eed0-4300-80eb-9ab7566c1a61 tempest-VolumesMetadataTest-955453549 None] Created volume successfully. Jun 02 16:16:54 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653" returned: 0 in 0.941s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:54 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653 Jun 02 16:16:54 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653" returned: 0 in 0.859s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:54 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:54 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-cdd4a97a-0c4e-4a6d-b5b7-41795eb90653" released by "delete_volume" :: held 1.956s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Created reservations ['4dbf54f9-9c8e-4a9c-a387-a1a0d863484a'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:16:55 devstack cinder-volume[86488]: WARNING cinder.quota [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-970774396 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-970774396, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Created reservations ['7f171331-ce9f-484a-8f8c-a46fb819574b', 'e2b0a6fd-d5fa-49ff-8f90-e286c55d4e56', '0aeefe78-8d19-4176-99b5-70197ecfa59e', 'd1d4ae5e-7cd6-41bf-bcb4-a1b010fb6a5d'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:16:55 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9c80f00-f57e-42f3-b436-4df1bb10c0a7 1073741824" returned: 0 in 1.462s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9c80f00-f57e-42f3-b436-4df1bb10c0a7 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Created reservations ['d67479cf-cda6-4c7b-babf-23849180f889', 'fd31263a-463a-4ce0-bc35-cb2d9fc33440', 'b496c2a8-26a0-4e85-8643-50b9fa92a39d', '011f0353-8927-4b75-8d3a-1c8fa687f8bc'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:16:55 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9c80f00-f57e-42f3-b436-4df1bb10c0a7 Jun 02 16:16:55 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-e3ee84fb-a124-4d37-b78f-44a0f15f06ea tempest-GroupsV320Test-2128839358 None] Created reservations ['88c216cf-5cf5-46e3-bd6e-658c54305c1d'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e3ee84fb-a124-4d37-b78f-44a0f15f06ea tempest-GroupsV320Test-2128839358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e3ee84fb-a124-4d37-b78f-44a0f15f06ea tempest-GroupsV320Test-2128839358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e3ee84fb-a124-4d37-b78f-44a0f15f06ea tempest-GroupsV320Test-2128839358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e3ee84fb-a124-4d37-b78f-44a0f15f06ea tempest-GroupsV320Test-2128839358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e3ee84fb-a124-4d37-b78f-44a0f15f06ea tempest-GroupsV320Test-2128839358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e3ee84fb-a124-4d37-b78f-44a0f15f06ea tempest-GroupsV320Test-2128839358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:55 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:16:55 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:56 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:16:56 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:56 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] Acquiring lock "cinder-098be561-ebbe-4b23-9185-1504e6f8621e-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:16:56 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] Lock "cinder-098be561-ebbe-4b23-9185-1504e6f8621e-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:56 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:56 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:56 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] Acquiring lock "cinder-quobyte-098be561-ebbe-4b23-9185-1504e6f8621e" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:16:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e3ee84fb-a124-4d37-b78f-44a0f15f06ea tempest-GroupsV320Test-2128839358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.973s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9c80f00-f57e-42f3-b436-4df1bb10c0a7" returned: 0 in 1.514s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:56 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-e3ee84fb-a124-4d37-b78f-44a0f15f06ea tempest-GroupsV320Test-2128839358 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:16:56 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] <== create_volume: return (3043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:16:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.055s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:56 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-e3ee84fb-a124-4d37-b78f-44a0f15f06ea tempest-GroupsV320Test-2128839358 None] Delete group completed successfully. Jun 02 16:16:57 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] Lock "cinder-quobyte-098be561-ebbe-4b23-9185-1504e6f8621e" acquired by "delete_volume" :: waited 0.066s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:16:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28010911-68e0-4f8d-96ec-bfe10febd059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c80f00-f57e-42f3-b436-4df1bb10c0a7', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a03d46-d7e0-4a01-9cd3-dc161821f604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:57 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4355348b-4cde-4ab9-88d5-6ed59e45da3d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:16:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-098be561-ebbe-4b23-9185-1504e6f8621e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:57 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Volume volume-b9c80f00-f57e-42f3-b436-4df1bb10c0a7 (b9c80f00-f57e-42f3-b436-4df1bb10c0a7): created successfully Jun 02 16:16:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a03d46-d7e0-4a01-9cd3-dc161821f604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Flow 'volume_create_manager' (f67109c2-c8d3-44ec-995d-91f2f1407b7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:16:57 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-28d7286d-f1d2-424c-9f00-b1460e022cec tempest-ServerRescueNegativeTestJSON-456347863 None] Created volume successfully. Jun 02 16:16:57 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-098be561-ebbe-4b23-9185-1504e6f8621e Jun 02 16:16:57 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:57 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-26873c32-058b-4f3d-b2d8-bc9f7bebb36e tempest-GroupSnapshotsTest-1776319603 None] Group tempest-GroupSnapshotsTest-Group-153768596: creating Jun 02 16:16:57 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-26873c32-058b-4f3d-b2d8-bc9f7bebb36e tempest-GroupSnapshotsTest-1776319603 None] Group tempest-GroupSnapshotsTest-Group-153768596: created successfully Jun 02 16:16:57 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-26873c32-058b-4f3d-b2d8-bc9f7bebb36e tempest-GroupSnapshotsTest-1776319603 None] Create group completed successfully. Jun 02 16:16:57 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.988s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:57 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:16:57 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-589edae6-5f2b-4a09-b264-7dc8f154a7f5 tempest-GroupSnapshotsTest-1776319603 None] Delete group completed successfully. Jun 02 16:16:58 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-098be561-ebbe-4b23-9185-1504e6f8621e" returned: 0 in 1.297s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-098be561-ebbe-4b23-9185-1504e6f8621e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:58 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-098be561-ebbe-4b23-9185-1504e6f8621e Jun 02 16:16:58 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:59 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-098be561-ebbe-4b23-9185-1504e6f8621e" returned: 0 in 1.041s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] Lock "cinder-quobyte-098be561-ebbe-4b23-9185-1504e6f8621e" released by "delete_volume" :: held 2.460s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Flow 'volume_create_manager' (c22ab288-e7a3-4551-a72b-c6710b3cd4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5fc97b1-b999-41e3-a731-7902423b165e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5fc97b1-b999-41e3-a731-7902423b165e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-236433261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f242a774-6cf9-4dd7-9717-09064c86f06b,host='devstack@QuobyteHD#QuobyteHD',id=6b54cff7-964e-49a1-b819-e1aad0cd38f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8687de7ed5a44b4fa1653b86ff51bebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:16:59Z,use_quota=True,user_id='b0e2967420ab4f6282af354d4b206ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91bb6d14-e521-4274-ad0b-91d52c46cbcd),volume_type_id=91bb6d14-e521-4274-ad0b-91d52c46cbcd)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014316f1-cc90-4ee2-a7e3-5ac9d47accb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014316f1-cc90-4ee2-a7e3-5ac9d47accb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73649382-1443-447c-bb85-0125c3ebda45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73649382-1443-447c-bb85-0125c3ebda45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b54cff7-964e-49a1-b819-e1aad0cd38f8', 'volume_name': 'volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b18fb6-409d-45c7-9fad-1c751277b5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b18fb6-409d-45c7-9fad-1c751277b5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297a7bf4-f359-4b56-a7a1-e4c9daeda82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:16:59 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Volume 6b54cff7-964e-49a1-b819-e1aad0cd38f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8', 'volume_size': 1} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f242a774-6cf9-4dd7-9717-09064c86f06b,created_at=2026-06-02T14:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-236433261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f242a774-6cf9-4dd7-9717-09064c86f06b,host='devstack@QuobyteHD#QuobyteHD',id=6b54cff7-964e-49a1-b819-e1aad0cd38f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8687de7ed5a44b4fa1653b86ff51bebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:16:59Z,use_quota=True,user_id='b0e2967420ab4f6282af354d4b206ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91bb6d14-e521-4274-ad0b-91d52c46cbcd),volume_type_id=91bb6d14-e521-4274-ad0b-91d52c46cbcd)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Creating volume 6b54cff7-964e-49a1-b819-e1aad0cd38f8 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:16:59 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:59 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8 1073741824 Jun 02 16:16:59 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] Created reservations ['f2f08312-14be-4e8b-9027-99079544a52b', '62a1fe60-7dd8-4bd8-b28d-3c4d9bff3dab', 'd0a09bfb-8d93-4007-91e4-6e113082838f', '33b1dfaa-6fb7-4b34-a0bd-65f82fc16c65'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:16:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:16:59 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:16:59 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:17:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:17:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:17:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:00 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:17:00 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:01 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.213s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:01 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:17:01 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] Deleted volume successfully. Jun 02 16:17:01 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0737a272-3472-4cf3-b2b4-08b1b84244a8 tempest-VolumesMetadataTest-955453549 None] Lock "cinder-098be561-ebbe-4b23-9185-1504e6f8621e-delete_volume" released by "delete_volume" :: held 4.323s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:01 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.209s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:01 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:17:01 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8 1073741824" returned: 0 in 1.995s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:01 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=119,cinder:INSERT=37,cinder:UPDATE=109,cinder:DELETE=5 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:17:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:01 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8 Jun 02 16:17:01 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:03 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8" returned: 0 in 1.519s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] <== create_volume: return (3591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:17:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.594s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297a7bf4-f359-4b56-a7a1-e4c9daeda82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e731347-7d48-428c-ac64-276dbea40654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:03 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Volume volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8 (6b54cff7-964e-49a1-b819-e1aad0cd38f8): created successfully Jun 02 16:17:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e731347-7d48-428c-ac64-276dbea40654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Flow 'volume_create_manager' (c22ab288-e7a3-4551-a72b-c6710b3cd4cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:17:03 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9e55c895-c3c7-4f6f-8d0b-8c5bbdcebbe9 tempest-GroupSnapshotsTest-1776319603 None] Created volume successfully. Jun 02 16:17:04 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] GroupSnapshot bb76d755-087a-4505-8095-ff075a8f140f: creating. Jun 02 16:17:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] Group snapshot bb76d755-087a-4505-8095-ff075a8f140f: creating. {{(pid=86488) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 02 16:17:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] Creating offline snapshot 0e9d1fa3-c494-48bc-91d7-b78fe0512e61 of volume 6b54cff7-964e-49a1-b819-e1aad0cd38f8 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:17:04 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0c1e6a-020b-4817-864a-598e75ce0f1b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:17:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:04 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8 Jun 02 16:17:04 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:05 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8" returned: 0 in 0.861s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:05 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61 1G Jun 02 16:17:05 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:06 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:17:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Flow 'volume_create_manager' (badb7ba8-b1bc-4b99-bc00-4fa29cee0b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:17:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ee0b22-694d-46c3-966a-de66be7ec192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ee0b22-694d-46c3-966a-de66be7ec192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1257172226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec79a0bb-35d4-4719-ba9e-05205a94a859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57b2e70157b244ae9ff85a845231db3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:17:06Z,use_quota=True,user_id='84d479a7d3b24a18b8f99dc31db7f9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1391a5-8270-4c36-a0e4-b69ce17d6ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1391a5-8270-4c36-a0e4-b69ce17d6ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8066bfc0-307a-432e-b9a1-6b00559c3920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8066bfc0-307a-432e-b9a1-6b00559c3920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec79a0bb-35d4-4719-ba9e-05205a94a859', 'volume_name': 'volume-ec79a0bb-35d4-4719-ba9e-05205a94a859', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0fc9bd-e392-4394-840c-695ede7cf8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0fc9bd-e392-4394-840c-695ede7cf8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce27df92-0267-45b4-ab63-59a39b1d3c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:06 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Volume ec79a0bb-35d4-4719-ba9e-05205a94a859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec79a0bb-35d4-4719-ba9e-05205a94a859', 'volume_size': 1} Jun 02 16:17:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:06 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61 1G" returned: 0 in 1.069s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:06 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61 Jun 02 16:17:06 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:07 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61" returned: 0 in 0.765s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:07 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61 is being set with open permissions: ugo+rw: NotImplementedError Jun 02 16:17:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:07 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61 Jun 02 16:17:07 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:08 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61" returned: 0 in 0.867s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:08 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.info Jun 02 16:17:08 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:09 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.info" returned: 0 in 0.819s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:09 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 16:17:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:09 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.info Jun 02 16:17:09 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:10 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.info" returned: 0 in 1.018s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.512s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.794s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1257172226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec79a0bb-35d4-4719-ba9e-05205a94a859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57b2e70157b244ae9ff85a845231db3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:17:06Z,use_quota=True,user_id='84d479a7d3b24a18b8f99dc31db7f9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:17:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Creating volume ec79a0bb-35d4-4719-ba9e-05205a94a859 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:17:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:17:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:17:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:17:10 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:17:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:10 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859 1073741824 Jun 02 16:17:10 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:10 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-a276bd92-f3fc-4b5f-b20a-585ad1dc3629 tempest-GroupSnapshotsTest-1776319603 None] group_snapshot bb76d755-087a-4505-8095-ff075a8f140f: created successfully Jun 02 16:17:11 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] group_snapshot bb76d755-087a-4505-8095-ff075a8f140f: deleting Jun 02 16:17:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] group_snapshot bb76d755-087a-4505-8095-ff075a8f140f: deleting {{(pid=86488) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 02 16:17:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "cinder-quobyte-6b54cff7-964e-49a1-b819-e1aad0cd38f8" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-6b54cff7-964e-49a1-b819-e1aad0cd38f8" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "cinder-quobyte-0e9d1fa3-c494-48bc-91d7-b78fe0512e61" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-0e9d1fa3-c494-48bc-91d7-b78fe0512e61" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:11 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] Deleting offline snapshot 0e9d1fa3-c494-48bc-91d7-b78fe0512e61 of volume 6b54cff7-964e-49a1-b819-e1aad0cd38f8 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:17:11 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] snapshot_file for this snap is: volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:17:11 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[496a6033-842c-4bbe-a357-1133cc7cb2e1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:17:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:11 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61 Jun 02 16:17:11 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:11 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859 1073741824" returned: 0 in 1.589s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:11 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859 Jun 02 16:17:11 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:12 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61" returned: 0 in 1.664s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:12 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:17:12 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[444340bb-649a-4e71-83b1-27a170bc0617]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:17:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:13 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8 Jun 02 16:17:13 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:13 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859" returned: 0 in 1.730s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] <== create_volume: return (3410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:17:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.414s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:13 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce27df92-0267-45b4-ab63-59a39b1d3c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec79a0bb-35d4-4719-ba9e-05205a94a859', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:13 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f92f162-384b-486f-8b4b-2490c4fe2e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:13 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Volume volume-ec79a0bb-35d4-4719-ba9e-05205a94a859 (ec79a0bb-35d4-4719-ba9e-05205a94a859): created successfully Jun 02 16:17:13 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f92f162-384b-486f-8b4b-2490c4fe2e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:13 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Flow 'volume_create_manager' (badb7ba8-b1bc-4b99-bc00-4fa29cee0b29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:17:13 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9745a121-02e9-4750-99fe-921b517791d8 tempest-SnapshotsActionsTest-616938903 None] Created volume successfully. Jun 02 16:17:13 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8" returned: 0 in 1.005s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:14 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61 Jun 02 16:17:14 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] Creating offline snapshot c2fab9e1-965f-4af2-96d8-186fe6967ed9 of volume ec79a0bb-35d4-4719-ba9e-05205a94a859 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:17:14 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9420642d-b323-48ae-82bf-e4f9ca0f8815]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:17:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:14 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859 Jun 02 16:17:14 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:15 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61" returned: 0 in 1.395s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:15 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61 Jun 02 16:17:15 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:15 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859" returned: 0 in 1.370s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:16 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 1G Jun 02 16:17:16 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:16 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8.0e9d1fa3-c494-48bc-91d7-b78fe0512e61" returned: 0 in 1.029s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-0e9d1fa3-c494-48bc-91d7-b78fe0512e61" released by "_delete_snapshot" :: held 5.282s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-6b54cff7-964e-49a1-b819-e1aad0cd38f8" released by "delete_snapshot" :: held 5.329s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:16 devstack cinder-volume[86488]: WARNING cinder.quota [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-359569147 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-359569147, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:17:16 devstack cinder-volume[86488]: WARNING cinder.quota [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-359569147 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-359569147, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:17:16 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] Created reservations ['1116ce81-7b5a-4693-b096-c7821eb0657c', '0161e542-0e58-46a1-a9b4-8a7bf735c589', '321e5d6b-e0f3-43b3-bf4b-db67e6704a21', '857f105c-3eed-4f68-995e-d3b9a0448049'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:17:16 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-30bedfc2-6ed4-4f65-b634-49391442afe7 tempest-GroupSnapshotsTest-1776319603 None] group_snapshot bb76d755-087a-4505-8095-ff075a8f140f: deleted successfully Jun 02 16:17:17 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 1G" returned: 0 in 1.413s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec79a0bb-35d4-4719-ba9e-05205a94a859 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "cinder-quobyte-6b54cff7-964e-49a1-b819-e1aad0cd38f8" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:17 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec79a0bb-35d4-4719-ba9e-05205a94a859 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 Jun 02 16:17:17 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-6b54cff7-964e-49a1-b819-e1aad0cd38f8" acquired by "delete_volume" :: waited 0.047s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:17 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a7d319-18f7-447d-ba6a-afa72e4fa5b9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:17:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:17 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8 Jun 02 16:17:17 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] Acquiring lock "cinder-b9c80f00-f57e-42f3-b436-4df1bb10c0a7-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] Lock "cinder-b9c80f00-f57e-42f3-b436-4df1bb10c0a7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] Acquiring lock "cinder-quobyte-b9c80f00-f57e-42f3-b436-4df1bb10c0a7" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] Lock "cinder-quobyte-b9c80f00-f57e-42f3-b436-4df1bb10c0a7" acquired by "delete_volume" :: waited 0.029s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:18 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ab7be9-7062-474e-b651-6eca4bd2f9e7]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:17:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9c80f00-f57e-42f3-b436-4df1bb10c0a7 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:18 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9c80f00-f57e-42f3-b436-4df1bb10c0a7 Jun 02 16:17:18 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:18 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec79a0bb-35d4-4719-ba9e-05205a94a859 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9" returned: 0 in 1.335s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:18 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 is being set with open permissions: ugo+rw Jun 02 16:17:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:18 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 Jun 02 16:17:18 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:19 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8" returned: 0 in 1.623s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:19 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8 Jun 02 16:17:19 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:19 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9c80f00-f57e-42f3-b436-4df1bb10c0a7" returned: 0 in 1.346s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9c80f00-f57e-42f3-b436-4df1bb10c0a7 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:19 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9c80f00-f57e-42f3-b436-4df1bb10c0a7 Jun 02 16:17:19 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:19 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9" returned: 0 in 1.103s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:20 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.info Jun 02 16:17:20 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:20 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b54cff7-964e-49a1-b819-e1aad0cd38f8" returned: 0 in 1.500s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] Lock "cinder-quobyte-6b54cff7-964e-49a1-b819-e1aad0cd38f8" released by "delete_volume" :: held 3.295s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:20 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] Created reservations ['30f9e156-cfd9-4709-b864-e06d5493823b'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:17:20 devstack cinder-volume[86488]: WARNING cinder.quota [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-359569147 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-359569147, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:17:20 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] Created reservations ['0688eb46-ca81-4aae-b1b6-546bd789ec11', '13329e9e-8443-4837-ba32-d9d90c41f78f', '70e1c8d0-0516-4d5b-b1bc-7d9f620f11d2', '2e81ff58-7ef7-409d-9a7b-f1d784a4fd3c'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:17:21 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9c80f00-f57e-42f3-b436-4df1bb10c0a7" returned: 0 in 1.525s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:21 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] Lock "cinder-quobyte-b9c80f00-f57e-42f3-b436-4df1bb10c0a7" released by "delete_volume" :: held 3.027s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:21 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.info" returned: 0 in 1.310s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:21 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.info is being set with open permissions: ugo+rw Jun 02 16:17:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:17:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:17:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:21 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.info Jun 02 16:17:21 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:21 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:17:21 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:21 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] Created reservations ['5e20d1ff-bdb4-469e-be17-088c7825572a', '30a29029-6c6e-465f-ab29-430c694dc009', 'f7f92140-4372-493d-8ac5-b9e657371f12', '014762fe-250c-480f-9bb9-aa3d8a815fc6'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:17:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:17:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:17:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:21 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:17:21 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:22 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.465s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:22 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:17:22 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-fb2e4c42-b108-4e80-a2f6-72baa7073a86 tempest-GroupSnapshotsTest-1776319603 None] Delete group completed successfully. Jun 02 16:17:23 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.info" returned: 0 in 2.315s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.143s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:23 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-18bade1e-7b8b-4d84-b56d-057d2b01ccf1 tempest-SnapshotsActionsTest-616938903 None] Create snapshot completed successfully Jun 02 16:17:23 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 2.169s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:23 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:17:23 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] Deleted volume successfully. Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-38d9b13f-eedc-4d31-9dd5-d402a6501095 tempest-ServerRescueNegativeTestJSON-456347863 None] Lock "cinder-b9c80f00-f57e-42f3-b436-4df1bb10c0a7-delete_volume" released by "delete_volume" :: held 5.852s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Flow 'volume_create_manager' (7b78d374-71a5-4ebe-a9f0-b7cce943e220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c23a4b-1373-419c-b103-2e7f9b3d0d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c23a4b-1373-419c-b103-2e7f9b3d0d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1899514355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ca09ee-e194-4745-a767-9b54c14616ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3666d756298a46838a0e3904621aad28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:17:24Z,use_quota=True,user_id='b089ac73c8d947668eb9347f644f8111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6436e1c6-29c6-451d-b008-096880da7f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6436e1c6-29c6-451d-b008-096880da7f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd1910e-03da-43df-8be7-fa6cf8b215ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd1910e-03da-43df-8be7-fa6cf8b215ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ca09ee-e194-4745-a767-9b54c14616ef', 'volume_name': 'volume-21ca09ee-e194-4745-a767-9b54c14616ef', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc5a23f8-9808-4088-9856-1bc2df69241d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc5a23f8-9808-4088-9856-1bc2df69241d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66656231-a9d1-468e-a3f7-56c6604199e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:24 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Volume 21ca09ee-e194-4745-a767-9b54c14616ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ca09ee-e194-4745-a767-9b54c14616ef', 'volume_size': 1} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1899514355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ca09ee-e194-4745-a767-9b54c14616ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3666d756298a46838a0e3904621aad28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:17:24Z,use_quota=True,user_id='b089ac73c8d947668eb9347f644f8111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Creating volume 21ca09ee-e194-4745-a767-9b54c14616ef {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:17:24 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:17:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:24 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef 1073741824 Jun 02 16:17:24 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:25 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef 1073741824" returned: 0 in 1.511s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:26 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef Jun 02 16:17:26 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e2ca82c0-acfa-4671-8d75-409a356fc03a tempest-SnapshotsActionsTest-616938903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:26 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef" returned: 0 in 0.908s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:26 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] <== create_volume: return (2489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:17:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.495s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e2ca82c0-acfa-4671-8d75-409a356fc03a tempest-SnapshotsActionsTest-616938903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.782s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:26 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66656231-a9d1-468e-a3f7-56c6604199e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ca09ee-e194-4745-a767-9b54c14616ef', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:26 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f13395-fa7c-4795-b2cb-881893d191b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:27 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-e2ca82c0-acfa-4671-8d75-409a356fc03a tempest-SnapshotsActionsTest-616938903 None] Creating offline snapshot b1c9cd03-a725-405b-b88f-91344b25ba63 of volume ec79a0bb-35d4-4719-ba9e-05205a94a859 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:17:27 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Volume volume-21ca09ee-e194-4745-a767-9b54c14616ef (21ca09ee-e194-4745-a767-9b54c14616ef): created successfully Jun 02 16:17:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f13395-fa7c-4795-b2cb-881893d191b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Flow 'volume_create_manager' (7b78d374-71a5-4ebe-a9f0-b7cce943e220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:17:27 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c70ecc-6b3b-4f16-a148-91091482a20a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:17:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e2ca82c0-acfa-4671-8d75-409a356fc03a tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:27 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-c5268951-06cf-476b-9bf7-4caf40e8721c tempest-VolumesActionsTest-97128112 None] Created volume successfully. Jun 02 16:17:27 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 Jun 02 16:17:27 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:28 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e2ca82c0-acfa-4671-8d75-409a356fc03a tempest-SnapshotsActionsTest-616938903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9" returned: 0 in 1.018s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-e2ca82c0-acfa-4671-8d75-409a356fc03a tempest-SnapshotsActionsTest-616938903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec79a0bb-35d4-4719-ba9e-05205a94a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:17:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e2ca82c0-acfa-4671-8d75-409a356fc03a tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:28 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63 1G Jun 02 16:17:28 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:29 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e2ca82c0-acfa-4671-8d75-409a356fc03a tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63 1G" returned: 0 in 1.309s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e2ca82c0-acfa-4671-8d75-409a356fc03a tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:29 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63 Jun 02 16:17:29 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:30 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e2ca82c0-acfa-4671-8d75-409a356fc03a tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63" returned: 0 in 0.862s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:30 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-e2ca82c0-acfa-4671-8d75-409a356fc03a tempest-SnapshotsActionsTest-616938903 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63 is being set with open permissions: ugo+rw Jun 02 16:17:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e2ca82c0-acfa-4671-8d75-409a356fc03a tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:30 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63 Jun 02 16:17:30 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:31 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e2ca82c0-acfa-4671-8d75-409a356fc03a tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63" returned: 0 in 0.788s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e2ca82c0-acfa-4671-8d75-409a356fc03a tempest-SnapshotsActionsTest-616938903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.262s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:31 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-e2ca82c0-acfa-4671-8d75-409a356fc03a tempest-SnapshotsActionsTest-616938903 None] Create snapshot completed successfully Jun 02 16:17:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Acquiring lock "cinder-b1c9cd03-a725-405b-b88f-91344b25ba63-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-b1c9cd03-a725-405b-b88f-91344b25ba63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Acquiring lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Acquiring lock "cinder-quobyte-b1c9cd03-a725-405b-b88f-91344b25ba63" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-quobyte-b1c9cd03-a725-405b-b88f-91344b25ba63" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Deleting offline snapshot b1c9cd03-a725-405b-b88f-91344b25ba63 of volume ec79a0bb-35d4-4719-ba9e-05205a94a859 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:17:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] snapshot_file for this snap is: volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:17:31 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dfd04b-a396-4cae-8f8c-2adc58d23ec9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:17:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:31 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63 Jun 02 16:17:31 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:32 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63" returned: 0 in 0.751s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec79a0bb-35d4-4719-ba9e-05205a94a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:17:32 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3e9dfa-e584-4530-9156-b2bf0a40c1b1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:17:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:32 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 Jun 02 16:17:32 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:33 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9" returned: 0 in 0.798s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:33 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec79a0bb-35d4-4719-ba9e-05205a94a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:17:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:33 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63 Jun 02 16:17:33 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:34 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63" returned: 0 in 0.923s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:34 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63 Jun 02 16:17:34 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:34 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.b1c9cd03-a725-405b-b88f-91344b25ba63" returned: 0 in 0.679s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-quobyte-b1c9cd03-a725-405b-b88f-91344b25ba63" released by "_delete_snapshot" :: held 3.290s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" released by "delete_snapshot" :: held 3.339s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:35 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:UPDATE=129,cinder:SELECT=97,cinder:INSERT=25,cinder:DELETE=6 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:17:35 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Created reservations ['154e1a55-0adf-4292-aebf-165aefcd4d0a', '2d1db4bb-335b-4c42-90f0-8d66a90e0f80', 'f787a403-c3ae-45d7-8b21-056c7c40bb30', '8747a0e8-2c34-41c1-983d-ca7bcbf53670'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:17:35 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Delete snapshot completed successfully. Jun 02 16:17:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bebd02a8-f48d-4b87-b6b7-fed6ddb1a4ff tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-b1c9cd03-a725-405b-b88f-91344b25ba63-delete_snapshot" released by "delete_snapshot" :: held 3.556s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cc0ab2b4-001b-4972-b712-7d033c6a4689 tempest-SnapshotsActionsTest-616938903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cc0ab2b4-001b-4972-b712-7d033c6a4689 tempest-SnapshotsActionsTest-616938903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-cc0ab2b4-001b-4972-b712-7d033c6a4689 tempest-SnapshotsActionsTest-616938903 None] Creating offline snapshot 1bc24a68-2a76-464a-a79f-af647c47c05d of volume ec79a0bb-35d4-4719-ba9e-05205a94a859 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:17:36 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[982579cb-3c31-4d89-b4a3-9ff85bd46dea]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:17:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cc0ab2b4-001b-4972-b712-7d033c6a4689 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:36 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 Jun 02 16:17:36 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:37 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cc0ab2b4-001b-4972-b712-7d033c6a4689 tempest-SnapshotsActionsTest-616938903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9" returned: 0 in 0.852s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:37 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-cc0ab2b4-001b-4972-b712-7d033c6a4689 tempest-SnapshotsActionsTest-616938903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec79a0bb-35d4-4719-ba9e-05205a94a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:17:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cc0ab2b4-001b-4972-b712-7d033c6a4689 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:37 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d 1G Jun 02 16:17:37 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:38 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cc0ab2b4-001b-4972-b712-7d033c6a4689 tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d 1G" returned: 0 in 0.964s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cc0ab2b4-001b-4972-b712-7d033c6a4689 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:38 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d Jun 02 16:17:38 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:39 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cc0ab2b4-001b-4972-b712-7d033c6a4689 tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d" returned: 0 in 0.844s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:39 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-cc0ab2b4-001b-4972-b712-7d033c6a4689 tempest-SnapshotsActionsTest-616938903 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d is being set with open permissions: ugo+rw Jun 02 16:17:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cc0ab2b4-001b-4972-b712-7d033c6a4689 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:39 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d Jun 02 16:17:39 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:39 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cc0ab2b4-001b-4972-b712-7d033c6a4689 tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d" returned: 0 in 0.732s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cc0ab2b4-001b-4972-b712-7d033c6a4689 tempest-SnapshotsActionsTest-616938903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.547s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:40 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-cc0ab2b4-001b-4972-b712-7d033c6a4689 tempest-SnapshotsActionsTest-616938903 None] Create snapshot completed successfully Jun 02 16:17:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Acquiring lock "cinder-1bc24a68-2a76-464a-a79f-af647c47c05d-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-1bc24a68-2a76-464a-a79f-af647c47c05d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Acquiring lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Acquiring lock "cinder-quobyte-1bc24a68-2a76-464a-a79f-af647c47c05d" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-quobyte-1bc24a68-2a76-464a-a79f-af647c47c05d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Deleting offline snapshot 1bc24a68-2a76-464a-a79f-af647c47c05d of volume ec79a0bb-35d4-4719-ba9e-05205a94a859 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:17:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] snapshot_file for this snap is: volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:17:40 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8be7f24-99f2-45de-9a1b-1b87b56ab6b3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:17:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:41 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d Jun 02 16:17:41 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:41 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d" returned: 0 in 0.827s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec79a0bb-35d4-4719-ba9e-05205a94a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:17:41 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6bde02-f40e-4447-81d3-21f3e7a77a1b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:17:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:41 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 Jun 02 16:17:41 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Flow 'volume_create_manager' (9a102293-621a-47e3-a76b-c2cd8d89d655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47b057f-e1ca-4bc6-9138-fe133ada6b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47b057f-e1ca-4bc6-9138-fe133ada6b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1764234476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6cb5c1c-ebdf-495c-8b61-372eae7ba226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ee599bcb27498f96c183b57dde325b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:17:42Z,use_quota=True,user_id='17e7f4eaa0184be78f3ae5db0f2e11b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5595eb77-be54-4275-96b3-0f370f57f041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5595eb77-be54-4275-96b3-0f370f57f041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1080bed9-1b32-4c41-87c8-4e43f96bce0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1080bed9-1b32-4c41-87c8-4e43f96bce0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6cb5c1c-ebdf-495c-8b61-372eae7ba226', 'volume_name': 'volume-b6cb5c1c-ebdf-495c-8b61-372eae7ba226', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232c50f3-09ab-4324-bcd2-2565c207c0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232c50f3-09ab-4324-bcd2-2565c207c0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a96d99f-b91f-43c0-a092-566ce9562069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:42 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Volume b6cb5c1c-ebdf-495c-8b61-372eae7ba226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6cb5c1c-ebdf-495c-8b61-372eae7ba226', 'volume_size': 1} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1764234476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6cb5c1c-ebdf-495c-8b61-372eae7ba226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ee599bcb27498f96c183b57dde325b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:17:42Z,use_quota=True,user_id='17e7f4eaa0184be78f3ae5db0f2e11b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Creating volume b6cb5c1c-ebdf-495c-8b61-372eae7ba226 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:17:42 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:17:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b6cb5c1c-ebdf-495c-8b61-372eae7ba226 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:42 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b6cb5c1c-ebdf-495c-8b61-372eae7ba226 1073741824 Jun 02 16:17:42 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:43 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9" returned: 0 in 1.380s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec79a0bb-35d4-4719-ba9e-05205a94a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:17:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:43 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d Jun 02 16:17:43 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:43 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b6cb5c1c-ebdf-495c-8b61-372eae7ba226 1073741824" returned: 0 in 1.407s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b6cb5c1c-ebdf-495c-8b61-372eae7ba226 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:43 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b6cb5c1c-ebdf-495c-8b61-372eae7ba226 Jun 02 16:17:43 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:44 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d" returned: 0 in 1.016s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:44 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d Jun 02 16:17:44 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:44 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b6cb5c1c-ebdf-495c-8b61-372eae7ba226" returned: 0 in 0.871s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] <== create_volume: return (2338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:17:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.343s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a96d99f-b91f-43c0-a092-566ce9562069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6cb5c1c-ebdf-495c-8b61-372eae7ba226', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb54012d-f298-49e5-9fd5-dd3fd8893fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:44 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Volume volume-b6cb5c1c-ebdf-495c-8b61-372eae7ba226 (b6cb5c1c-ebdf-495c-8b61-372eae7ba226): created successfully Jun 02 16:17:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb54012d-f298-49e5-9fd5-dd3fd8893fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Flow 'volume_create_manager' (9a102293-621a-47e3-a76b-c2cd8d89d655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:17:44 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f8a3a40f-90ff-4750-8acb-72f3dadda010 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Created volume successfully. Jun 02 16:17:45 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.1bc24a68-2a76-464a-a79f-af647c47c05d" returned: 0 in 0.915s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:45 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-quobyte-1bc24a68-2a76-464a-a79f-af647c47c05d" released by "_delete_snapshot" :: held 4.294s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:45 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" released by "delete_snapshot" :: held 4.329s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:45 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Created reservations ['6021c3d5-aa59-4d08-a0af-1e5fa3e1fdb3', '8dc1d975-cdb4-4a66-9ee2-ed1050e39a8c', '46ddd7cd-f4df-44ed-abc6-8257a226e754', '95ba1171-d046-4a88-8773-1b0063847649'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:17:45 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Delete snapshot completed successfully. Jun 02 16:17:45 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9d9b5a5d-9e46-43b3-8de7-28896db1931d tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-1bc24a68-2a76-464a-a79f-af647c47c05d-delete_snapshot" released by "delete_snapshot" :: held 4.533s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-29dc8637-10ab-473c-a335-1a763d8a35d1 tempest-VolumesActionsTest-97128112 None] Acquiring lock "cinder-21ca09ee-e194-4745-a767-9b54c14616ef" by "attach_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-29dc8637-10ab-473c-a335-1a763d8a35d1 tempest-VolumesActionsTest-97128112 None] Lock "cinder-21ca09ee-e194-4745-a767-9b54c14616ef" acquired by "attach_volume" :: waited 0.022s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:46 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-29dc8637-10ab-473c-a335-1a763d8a35d1 tempest-VolumesActionsTest-97128112 None] Attaching volume 21ca09ee-e194-4745-a767-9b54c14616ef to instance 164c8fde-b125-4da6-b6f1-ebc3500767bc at mountpoint /dev/vdb on host None. Jun 02 16:17:46 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-29dc8637-10ab-473c-a335-1a763d8a35d1 tempest-VolumesActionsTest-97128112 None] Attach volume completed successfully. Jun 02 16:17:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-29dc8637-10ab-473c-a335-1a763d8a35d1 tempest-VolumesActionsTest-97128112 None] Lock "cinder-21ca09ee-e194-4745-a767-9b54c14616ef" released by "attach_volume" :: held 0.118s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5667ae27-8af8-44c5-8fce-55c23408e277 tempest-VolumesActionsTest-97128112 None] Acquiring lock "cinder-21ca09ee-e194-4745-a767-9b54c14616ef-detach_volume" by "detach_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5667ae27-8af8-44c5-8fce-55c23408e277 tempest-VolumesActionsTest-97128112 None] Lock "cinder-21ca09ee-e194-4745-a767-9b54c14616ef-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:46 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-5667ae27-8af8-44c5-8fce-55c23408e277 tempest-VolumesActionsTest-97128112 None] Detaching volume 21ca09ee-e194-4745-a767-9b54c14616ef from instance 164c8fde-b125-4da6-b6f1-ebc3500767bc. Jun 02 16:17:46 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-5667ae27-8af8-44c5-8fce-55c23408e277 tempest-VolumesActionsTest-97128112 None] Detach volume completed successfully. Jun 02 16:17:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5667ae27-8af8-44c5-8fce-55c23408e277 tempest-VolumesActionsTest-97128112 None] Lock "cinder-21ca09ee-e194-4745-a767-9b54c14616ef-detach_volume" released by "detach_volume" :: held 0.114s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a7f12a0f-b7ef-4571-8f2b-ec89bba6bc88 tempest-SnapshotsActionsTest-616938903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a7f12a0f-b7ef-4571-8f2b-ec89bba6bc88 tempest-SnapshotsActionsTest-616938903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Acquiring lock "cinder-b6cb5c1c-ebdf-495c-8b61-372eae7ba226-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:47 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-a7f12a0f-b7ef-4571-8f2b-ec89bba6bc88 tempest-SnapshotsActionsTest-616938903 None] Creating offline snapshot f20ddcff-085b-499b-8da3-212ec7c90834 of volume ec79a0bb-35d4-4719-ba9e-05205a94a859 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:17:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Lock "cinder-b6cb5c1c-ebdf-495c-8b61-372eae7ba226-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:47 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c99fefb-ab0c-4463-b5f4-d10d0cf91329]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:17:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a7f12a0f-b7ef-4571-8f2b-ec89bba6bc88 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Acquiring lock "cinder-quobyte-b6cb5c1c-ebdf-495c-8b61-372eae7ba226" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Lock "cinder-quobyte-b6cb5c1c-ebdf-495c-8b61-372eae7ba226" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:47 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b714ba-7b57-4af4-a1b3-7feed7c60f74]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:17:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b6cb5c1c-ebdf-495c-8b61-372eae7ba226 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:47 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 Jun 02 16:17:47 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:47 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b6cb5c1c-ebdf-495c-8b61-372eae7ba226 Jun 02 16:17:47 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:48 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a7f12a0f-b7ef-4571-8f2b-ec89bba6bc88 tempest-SnapshotsActionsTest-616938903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9" returned: 0 in 1.118s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-a7f12a0f-b7ef-4571-8f2b-ec89bba6bc88 tempest-SnapshotsActionsTest-616938903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec79a0bb-35d4-4719-ba9e-05205a94a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:17:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a7f12a0f-b7ef-4571-8f2b-ec89bba6bc88 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:48 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834 1G Jun 02 16:17:48 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:48 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b6cb5c1c-ebdf-495c-8b61-372eae7ba226" returned: 0 in 1.177s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b6cb5c1c-ebdf-495c-8b61-372eae7ba226 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:48 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b6cb5c1c-ebdf-495c-8b61-372eae7ba226 Jun 02 16:17:48 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:49 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b6cb5c1c-ebdf-495c-8b61-372eae7ba226" returned: 0 in 1.020s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:49 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Lock "cinder-quobyte-b6cb5c1c-ebdf-495c-8b61-372eae7ba226" released by "delete_volume" :: held 2.263s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:49 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Created reservations ['dea793f8-2940-4b46-b65e-9ba7defb56e5', '8cd771a5-cce5-4c6d-87f3-3fd2d3fb088a', '0c7e6f51-f925-4eab-af42-b2dd6580d8ec', '1f4b63bf-3a3a-43cc-ac7f-4f4ea3449cf0'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:17:49 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a7f12a0f-b7ef-4571-8f2b-ec89bba6bc88 tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834 1G" returned: 0 in 1.285s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a7f12a0f-b7ef-4571-8f2b-ec89bba6bc88 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:49 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834 Jun 02 16:17:49 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:49 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:17:49 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:17:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:49 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:17:49 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:50 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a7f12a0f-b7ef-4571-8f2b-ec89bba6bc88 tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834" returned: 0 in 0.718s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:50 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-a7f12a0f-b7ef-4571-8f2b-ec89bba6bc88 tempest-SnapshotsActionsTest-616938903 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834 is being set with open permissions: ugo+rw Jun 02 16:17:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a7f12a0f-b7ef-4571-8f2b-ec89bba6bc88 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:50 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:50 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834 Jun 02 16:17:50 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.673s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:50 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:17:50 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Deleted volume successfully. Jun 02 16:17:50 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7c3c15b7-833e-44a7-b3b7-63d08a1b9302 tempest-VolumeQuotasNegativeTestJSON-1095756420 None] Lock "cinder-b6cb5c1c-ebdf-495c-8b61-372eae7ba226-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:51 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a7f12a0f-b7ef-4571-8f2b-ec89bba6bc88 tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834" returned: 0 in 0.804s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a7f12a0f-b7ef-4571-8f2b-ec89bba6bc88 tempest-SnapshotsActionsTest-616938903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.097s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:51 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-a7f12a0f-b7ef-4571-8f2b-ec89bba6bc88 tempest-SnapshotsActionsTest-616938903 None] Create snapshot completed successfully Jun 02 16:17:51 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Acquiring lock "cinder-f20ddcff-085b-499b-8da3-212ec7c90834-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:51 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-f20ddcff-085b-499b-8da3-212ec7c90834-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:51 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Acquiring lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:51 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:51 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Acquiring lock "cinder-quobyte-f20ddcff-085b-499b-8da3-212ec7c90834" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:17:51 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-quobyte-f20ddcff-085b-499b-8da3-212ec7c90834" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:17:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Deleting offline snapshot f20ddcff-085b-499b-8da3-212ec7c90834 of volume ec79a0bb-35d4-4719-ba9e-05205a94a859 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:17:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] snapshot_file for this snap is: volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:17:51 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[97aa3d7c-af83-450f-9df9-da1fb33bfacc]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:17:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:51 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834 Jun 02 16:17:51 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:52 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834" returned: 0 in 0.906s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:52 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec79a0bb-35d4-4719-ba9e-05205a94a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:17:52 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0fd764-3496-4c8c-be70-cfb4fbb10e8a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:17:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:52 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 Jun 02 16:17:52 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:53 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9" returned: 0 in 0.939s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec79a0bb-35d4-4719-ba9e-05205a94a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:17:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:53 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834 Jun 02 16:17:53 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:54 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834" returned: 0 in 0.915s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:54 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834 Jun 02 16:17:54 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:55 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.f20ddcff-085b-499b-8da3-212ec7c90834" returned: 0 in 0.743s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:55 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-quobyte-f20ddcff-085b-499b-8da3-212ec7c90834" released by "_delete_snapshot" :: held 3.666s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:55 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" released by "delete_snapshot" :: held 3.708s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:55 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Created reservations ['7df36f71-26d4-4c5b-ada3-ff1bea6739ef', 'a849caba-e695-4850-a1dc-8111ced8ecf9', 'bb85cfc6-e1ea-4853-a4b2-b05f5bf8079f', '72fd8fa3-78ff-4d1f-a815-92a64524665a'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:17:55 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Delete snapshot completed successfully. Jun 02 16:17:55 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d8163e9d-9604-4947-99df-e80869497aca tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-f20ddcff-085b-499b-8da3-212ec7c90834-delete_snapshot" released by "delete_snapshot" :: held 3.876s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:17:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-51517ffb-6a3d-4f43-bb8a-46c0e635b04e tempest-SnapshotsActionsTest-616938903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-51517ffb-6a3d-4f43-bb8a-46c0e635b04e tempest-SnapshotsActionsTest-616938903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:56 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-51517ffb-6a3d-4f43-bb8a-46c0e635b04e tempest-SnapshotsActionsTest-616938903 None] Creating offline snapshot 38952b2f-236b-44b4-95f6-1d715432e8f3 of volume ec79a0bb-35d4-4719-ba9e-05205a94a859 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:17:56 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fb0d3d-e7f9-4792-b744-e097cbfbfdbd]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:17:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-51517ffb-6a3d-4f43-bb8a-46c0e635b04e tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:56 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 Jun 02 16:17:56 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:57 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-51517ffb-6a3d-4f43-bb8a-46c0e635b04e tempest-SnapshotsActionsTest-616938903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9" returned: 0 in 0.848s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-51517ffb-6a3d-4f43-bb8a-46c0e635b04e tempest-SnapshotsActionsTest-616938903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec79a0bb-35d4-4719-ba9e-05205a94a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:17:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-51517ffb-6a3d-4f43-bb8a-46c0e635b04e tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:57 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3 1G Jun 02 16:17:57 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:57 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:17:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Flow 'volume_create_manager' (5cdb70ef-6685-44ea-9b32-f7875dd49ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:17:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987785aa-5e70-469d-9e7b-f6341b2ae9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987785aa-5e70-469d-9e7b-f6341b2ae9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1596748754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2849bbe-f43b-4a8a-a7bd-1b71223543db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99827ead46d4984bd58a978e6353ecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:17:58Z,use_quota=True,user_id='145c3557da7845d1b3a5248603b6d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3513da50-6c22-494e-91ac-3c13dc87b9d9),volume_type_id=3513da50-6c22-494e-91ac-3c13dc87b9d9)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3efaca37-0e4a-4396-8862-8394bc72eac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3efaca37-0e4a-4396-8862-8394bc72eac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2e712f-cb19-42db-a6fd-d95bdbcbc17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2e712f-cb19-42db-a6fd-d95bdbcbc17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2849bbe-f43b-4a8a-a7bd-1b71223543db', 'volume_name': 'volume-e2849bbe-f43b-4a8a-a7bd-1b71223543db', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb47d50-0220-401e-a87a-851b0579b1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb47d50-0220-401e-a87a-851b0579b1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:17:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4abe80f-ea7d-497d-bc1b-fa53cd85230d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:17:57 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Volume e2849bbe-f43b-4a8a-a7bd-1b71223543db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2849bbe-f43b-4a8a-a7bd-1b71223543db', 'volume_size': 1} Jun 02 16:17:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:58 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-51517ffb-6a3d-4f43-bb8a-46c0e635b04e tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3 1G" returned: 0 in 1.024s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-51517ffb-6a3d-4f43-bb8a-46c0e635b04e tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:58 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3 Jun 02 16:17:58 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:58 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-7f745593-c2c8-4252-93c5-896c6e5fa2d0 tempest-GroupsV314Test-684910249 None] Group tempest-GroupsV314Test-Group-574649964: creating Jun 02 16:17:58 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-7f745593-c2c8-4252-93c5-896c6e5fa2d0 tempest-GroupsV314Test-684910249 None] Group tempest-GroupsV314Test-Group-574649964: created successfully Jun 02 16:17:58 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-7f745593-c2c8-4252-93c5-896c6e5fa2d0 tempest-GroupsV314Test-684910249 None] Create group completed successfully. Jun 02 16:17:58 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-51517ffb-6a3d-4f43-bb8a-46c0e635b04e tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3" returned: 0 in 0.660s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:58 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-51517ffb-6a3d-4f43-bb8a-46c0e635b04e tempest-SnapshotsActionsTest-616938903 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3 is being set with open permissions: ugo+rw Jun 02 16:17:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-51517ffb-6a3d-4f43-bb8a-46c0e635b04e tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:58 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3 Jun 02 16:17:58 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:59 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Jun 02 16:17:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-51517ffb-6a3d-4f43-bb8a-46c0e635b04e tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3" returned: 0 in 0.595s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:17:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-51517ffb-6a3d-4f43-bb8a-46c0e635b04e tempest-SnapshotsActionsTest-616938903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.321s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.820s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1596748754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2849bbe-f43b-4a8a-a7bd-1b71223543db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99827ead46d4984bd58a978e6353ecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:17:58Z,use_quota=True,user_id='145c3557da7845d1b3a5248603b6d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3513da50-6c22-494e-91ac-3c13dc87b9d9),volume_type_id=3513da50-6c22-494e-91ac-3c13dc87b9d9)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:17:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Creating volume e2849bbe-f43b-4a8a-a7bd-1b71223543db {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:17:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:17:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:17:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:17:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:17:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:17:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:17:59 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:17:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e2849bbe-f43b-4a8a-a7bd-1b71223543db 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:17:59 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e2849bbe-f43b-4a8a-a7bd-1b71223543db 1073741824 Jun 02 16:17:59 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:17:59 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-51517ffb-6a3d-4f43-bb8a-46c0e635b04e tempest-SnapshotsActionsTest-616938903 None] Create snapshot completed successfully Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:00 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:18:00 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Flow 'volume_create_manager' (902756e7-c0b6-4aee-9b9e-092d2f52abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4cec45-68f5-447b-959c-e1c2b79a3826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4cec45-68f5-447b-959c-e1c2b79a3826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-570022738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78ba22f6-44fc-420f-8278-85ff465f0d58,host='devstack@QuobyteHD#QuobyteHD',id=de345f75-a3fd-4941-930c-bc6223da072e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3045c4182ee4ff99ad1b2414c43c5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:18:00Z,use_quota=True,user_id='80c44ebd30c5465d9d975043a2f350fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48b27e8f-67fd-4906-b80c-c3af34d0d4f1),volume_type_id=48b27e8f-67fd-4906-b80c-c3af34d0d4f1)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0862203-5b93-4220-836c-288aec9f096b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0862203-5b93-4220-836c-288aec9f096b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6b4bf5-0a5d-4c36-8ddb-f101b3c99bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6b4bf5-0a5d-4c36-8ddb-f101b3c99bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de345f75-a3fd-4941-930c-bc6223da072e', 'volume_name': 'volume-de345f75-a3fd-4941-930c-bc6223da072e', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d279f4c-a5f5-4c89-930a-a20556fcb585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d279f4c-a5f5-4c89-930a-a20556fcb585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6db9d9-8fbd-4bcd-a16a-d8189b91d095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:00 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Volume de345f75-a3fd-4941-930c-bc6223da072e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de345f75-a3fd-4941-930c-bc6223da072e', 'volume_size': 1} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Acquiring lock "cinder-38952b2f-236b-44b4-95f6-1d715432e8f3-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:18:00 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e2849bbe-f43b-4a8a-a7bd-1b71223543db 1073741824" returned: 0 in 0.971s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-38952b2f-236b-44b4-95f6-1d715432e8f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Acquiring lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Acquiring lock "cinder-quobyte-38952b2f-236b-44b4-95f6-1d715432e8f3" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e2849bbe-f43b-4a8a-a7bd-1b71223543db {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-quobyte-38952b2f-236b-44b4-95f6-1d715432e8f3" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Deleting offline snapshot 38952b2f-236b-44b4-95f6-1d715432e8f3 of volume ec79a0bb-35d4-4719-ba9e-05205a94a859 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:18:00 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e2849bbe-f43b-4a8a-a7bd-1b71223543db Jun 02 16:18:00 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] snapshot_file for this snap is: volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6a874c-0f3c-4202-99e8-9cafd74ddb38]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:00 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3 Jun 02 16:18:00 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:00 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.758s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:00 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:18:01 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e2849bbe-f43b-4a8a-a7bd-1b71223543db" returned: 0 in 0.706s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.004s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=78ba22f6-44fc-420f-8278-85ff465f0d58,created_at=2026-06-02T14:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-570022738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78ba22f6-44fc-420f-8278-85ff465f0d58,host='devstack@QuobyteHD#QuobyteHD',id=de345f75-a3fd-4941-930c-bc6223da072e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3045c4182ee4ff99ad1b2414c43c5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:18:00Z,use_quota=True,user_id='80c44ebd30c5465d9d975043a2f350fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48b27e8f-67fd-4906-b80c-c3af34d0d4f1),volume_type_id=48b27e8f-67fd-4906-b80c-c3af34d0d4f1)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Creating volume de345f75-a3fd-4941-930c-bc6223da072e {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:18:01 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4abe80f-ea7d-497d-bc1b-fa53cd85230d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2849bbe-f43b-4a8a-a7bd-1b71223543db', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71d4d55-e204-4b45-a5f2-0d0b62726cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:01 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e 1073741824 Jun 02 16:18:01 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:01 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Volume volume-e2849bbe-f43b-4a8a-a7bd-1b71223543db (e2849bbe-f43b-4a8a-a7bd-1b71223543db): created successfully Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71d4d55-e204-4b45-a5f2-0d0b62726cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Flow 'volume_create_manager' (5cdb70ef-6685-44ea-9b32-f7875dd49ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:18:01 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-e9ff3cfc-2653-467a-8cc9-10bcbb112eca tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Created volume successfully. Jun 02 16:18:01 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3" returned: 0 in 0.862s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec79a0bb-35d4-4719-ba9e-05205a94a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46f9d4e-2f18-4960-9760-daa176fecd52]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:18:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:01 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 Jun 02 16:18:01 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:02 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:UPDATE=75,cinder:DELETE=8,cinder:SELECT=77,cinder:INSERT=16 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:18:02 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e 1073741824" returned: 0 in 1.243s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:02 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9" returned: 0 in 1.034s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec79a0bb-35d4-4719-ba9e-05205a94a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:18:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:02 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3 Jun 02 16:18:02 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-04958c67-1ad5-4f99-b6f7-5568ee1d9c68 tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-04958c67-1ad5-4f99-b6f7-5568ee1d9c68 tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:18:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-04958c67-1ad5-4f99-b6f7-5568ee1d9c68 tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:18:02 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e Jun 02 16:18:02 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-04958c67-1ad5-4f99-b6f7-5568ee1d9c68 tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:18:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-04958c67-1ad5-4f99-b6f7-5568ee1d9c68 tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:18:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-04958c67-1ad5-4f99-b6f7-5568ee1d9c68 tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:02 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:18:02 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:03 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-04958c67-1ad5-4f99-b6f7-5568ee1d9c68 tempest-VolumeRetypeWithoutMigrationTest-4011439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.819s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:03 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-04958c67-1ad5-4f99-b6f7-5568ee1d9c68 tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:18:03 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-04958c67-1ad5-4f99-b6f7-5568ee1d9c68 tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Retype volume completed successfully. Jun 02 16:18:03 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3" returned: 0 in 1.000s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:03 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3 Jun 02 16:18:03 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:03 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e" returned: 0 in 1.068s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] <== create_volume: return (2410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:18:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.417s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:18:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6db9d9-8fbd-4bcd-a16a-d8189b91d095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de345f75-a3fd-4941-930c-bc6223da072e', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a4929b-f144-4a78-93d0-e2c47df1ea28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:03 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Volume volume-de345f75-a3fd-4941-930c-bc6223da072e (de345f75-a3fd-4941-930c-bc6223da072e): created successfully Jun 02 16:18:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a4929b-f144-4a78-93d0-e2c47df1ea28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Flow 'volume_create_manager' (902756e7-c0b6-4aee-9b9e-092d2f52abc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:18:03 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-75a5201e-a56f-4247-8f93-74610e32c79b tempest-GroupsV314Test-684910249 None] Created volume successfully. Jun 02 16:18:03 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Acquiring lock "cinder-e2849bbe-f43b-4a8a-a7bd-1b71223543db-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:18:03 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Lock "cinder-e2849bbe-f43b-4a8a-a7bd-1b71223543db-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:18:04 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Acquiring lock "cinder-quobyte-e2849bbe-f43b-4a8a-a7bd-1b71223543db" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:18:04 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Lock "cinder-quobyte-e2849bbe-f43b-4a8a-a7bd-1b71223543db" acquired by "delete_volume" :: waited 0.014s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:18:04 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb43733f-e99d-48ab-92e3-89742d0c9724]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:18:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e2849bbe-f43b-4a8a-a7bd-1b71223543db {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:04 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e2849bbe-f43b-4a8a-a7bd-1b71223543db Jun 02 16:18:04 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:04 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.38952b2f-236b-44b4-95f6-1d715432e8f3" returned: 0 in 0.838s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:04 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-quobyte-38952b2f-236b-44b4-95f6-1d715432e8f3" released by "_delete_snapshot" :: held 3.880s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:18:04 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" released by "delete_snapshot" :: held 3.915s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:18:04 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Created reservations ['0b7686f8-0b45-47c3-b05b-b1093146f5a6', '2e71ba04-45c3-47fc-8b7c-459a4004d5f4', 'f52b1c2b-5be8-4a0f-ba10-1872b2983335', 'f57bd755-37ba-4839-996a-003b64258a2b'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:18:04 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Delete snapshot completed successfully. Jun 02 16:18:04 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3494326b-c1f2-4c69-a301-3f09e38aee7d tempest-SnapshotsActionsTest-509653538 None] Lock "cinder-38952b2f-236b-44b4-95f6-1d715432e8f3-delete_snapshot" released by "delete_snapshot" :: held 4.081s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:18:04 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e2849bbe-f43b-4a8a-a7bd-1b71223543db" returned: 0 in 0.836s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e2849bbe-f43b-4a8a-a7bd-1b71223543db {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:04 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e2849bbe-f43b-4a8a-a7bd-1b71223543db Jun 02 16:18:04 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] Acquiring lock "cinder-c2fab9e1-965f-4af2-96d8-186fe6967ed9-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] Lock "cinder-c2fab9e1-965f-4af2-96d8-186fe6967ed9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] Acquiring lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] Lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] Acquiring lock "cinder-quobyte-c2fab9e1-965f-4af2-96d8-186fe6967ed9" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] Lock "cinder-quobyte-c2fab9e1-965f-4af2-96d8-186fe6967ed9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] Deleting offline snapshot c2fab9e1-965f-4af2-96d8-186fe6967ed9 of volume ec79a0bb-35d4-4719-ba9e-05205a94a859 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] snapshot_file for this snap is: volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c5c769-a5e7-4a9b-b15e-49e9c3c95df8]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:05 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 Jun 02 16:18:05 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:05 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e2849bbe-f43b-4a8a-a7bd-1b71223543db" returned: 0 in 0.660s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Lock "cinder-quobyte-e2849bbe-f43b-4a8a-a7bd-1b71223543db" released by "delete_volume" :: held 1.545s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:18:05 devstack cinder-volume[86488]: WARNING cinder.quota [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:18:05 devstack cinder-volume[86488]: WARNING cinder.quota [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Created reservations ['22497ea3-b7ec-4880-a82a-64a437ccf824', 'e737fba3-435e-402d-8523-594faaf4e426', '258296e3-4c93-4f2e-9906-6753a32d400e', 'dd587042-bedd-4d4b-b261-dbc383ca7e90'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:05 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:18:05 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:18:05 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Cloning volume de345f75-a3fd-4941-930c-bc6223da072e to volume 53cf3013-3c91-4b05-9053-42d960e59340 Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Creating offline snapshot 2625dcb1-d819-4ab5-a38c-39e9ccbbef36 of volume de345f75-a3fd-4941-930c-bc6223da072e {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d29d79-5ea9-4523-8aad-04396d694e18]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:18:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:06 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e Jun 02 16:18:06 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:06 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9" returned: 0 in 0.938s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec79a0bb-35d4-4719-ba9e-05205a94a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:18:06 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a355ba3-1721-4d7c-a963-06fe93d213a2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:18:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:06 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859 Jun 02 16:18:06 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:06 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.760s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:06 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:18:06 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Deleted volume successfully. Jun 02 16:18:06 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ef2cc3e1-50bc-496b-8f1c-9cf040704eff tempest-VolumeRetypeWithoutMigrationTest-4011439 None] Lock "cinder-e2849bbe-f43b-4a8a-a7bd-1b71223543db-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:18:06 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e" returned: 0 in 0.901s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:06 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36 1G Jun 02 16:18:06 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:07 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859" returned: 0 in 0.896s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:07 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 Jun 02 16:18:07 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:07 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36 1G" returned: 0 in 1.023s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de345f75-a3fd-4941-930c-bc6223da072e -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:07 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de345f75-a3fd-4941-930c-bc6223da072e -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36 Jun 02 16:18:07 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:08 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9" returned: 0 in 0.881s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:08 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9 Jun 02 16:18:08 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:08 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de345f75-a3fd-4941-930c-bc6223da072e -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36" returned: 0 in 0.982s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:08 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36 is being set with open permissions: ugo+rw: NotImplementedError Jun 02 16:18:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:08 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36 Jun 02 16:18:08 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:09 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859.c2fab9e1-965f-4af2-96d8-186fe6967ed9" returned: 0 in 0.941s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] Lock "cinder-quobyte-c2fab9e1-965f-4af2-96d8-186fe6967ed9" released by "_delete_snapshot" :: held 3.891s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:18:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] Lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" released by "delete_snapshot" :: held 3.922s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:18:09 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] Created reservations ['96e4146e-fb46-4128-b673-a59a3c952d89', 'dfec60cc-7ee5-49be-b711-2c480e54cc4e', 'bb2b72bc-b46f-491f-911a-76e75eeb7739', 'b454ac16-968f-48a7-bbe9-5877aa5cb8ad'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:18:09 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] Delete snapshot completed successfully. Jun 02 16:18:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-35d55d1c-c233-4c56-be12-1b879089e436 tempest-SnapshotsActionsTest-616938903 None] Lock "cinder-c2fab9e1-965f-4af2-96d8-186fe6967ed9-delete_snapshot" released by "delete_snapshot" :: held 4.260s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:18:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] Acquiring lock "cinder-ec79a0bb-35d4-4719-ba9e-05205a94a859-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:18:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] Lock "cinder-ec79a0bb-35d4-4719-ba9e-05205a94a859-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:18:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] Acquiring lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:18:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] Lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" acquired by "delete_volume" :: waited 0.024s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:18:09 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[85024090-aaff-451a-a681-f7a3ea686b65]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:18:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:10 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859 Jun 02 16:18:10 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:10 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36" returned: 0 in 1.502s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:10 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.info Jun 02 16:18:10 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:11 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859" returned: 0 in 1.508s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:11 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859 Jun 02 16:18:11 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:11 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.info" returned: 0 in 1.199s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:11 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 16:18:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:11 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.info Jun 02 16:18:11 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0478d1c0-0ed0-433c-96c9-ac93a2d211e9 tempest-VolumesActionsTest-97128112 None] Acquiring lock "cinder-21ca09ee-e194-4745-a767-9b54c14616ef" by "attach_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:18:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0478d1c0-0ed0-433c-96c9-ac93a2d211e9 tempest-VolumesActionsTest-97128112 None] Lock "cinder-21ca09ee-e194-4745-a767-9b54c14616ef" acquired by "attach_volume" :: waited 0.032s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:18:12 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0478d1c0-0ed0-433c-96c9-ac93a2d211e9 tempest-VolumesActionsTest-97128112 None] Attaching volume 21ca09ee-e194-4745-a767-9b54c14616ef to instance 367efe6f-2468-4bed-bc37-a2907a97c6ec at mountpoint /dev/vdb on host None. Jun 02 16:18:12 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0478d1c0-0ed0-433c-96c9-ac93a2d211e9 tempest-VolumesActionsTest-97128112 None] Attach volume completed successfully. Jun 02 16:18:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0478d1c0-0ed0-433c-96c9-ac93a2d211e9 tempest-VolumesActionsTest-97128112 None] Lock "cinder-21ca09ee-e194-4745-a767-9b54c14616ef" released by "attach_volume" :: held 0.184s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:18:12 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ec79a0bb-35d4-4719-ba9e-05205a94a859" returned: 0 in 1.019s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] Lock "cinder-quobyte-ec79a0bb-35d4-4719-ba9e-05205a94a859" released by "delete_volume" :: held 2.657s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:18:12 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] Created reservations ['65663256-d4e4-42fd-aefa-158063c2be71', '36edf307-2b27-4117-bf56-a0279de53a80', '9eb9840e-bec1-47d6-99e0-3aa9fb74a6a4', '9a308258-1854-4cd2-8f43-ec260e2c496b'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:18:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:18:12 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:18:12 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:18:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:18:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:12 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:18:12 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:13 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.info" returned: 0 in 1.373s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Acquiring lock "cinder-quobyte-53cf3013-3c91-4b05-9053-42d960e59340" by "_copy_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:18:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0abb7bc3-206c-4d99-92c9-51b78e24bcb9 tempest-VolumesActionsTest-97128112 None] Acquiring lock "cinder-21ca09ee-e194-4745-a767-9b54c14616ef-detach_volume" by "detach_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:18:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Lock "cinder-quobyte-53cf3013-3c91-4b05-9053-42d960e59340" acquired by "_copy_volume_from_snapshot" :: waited 0.050s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:18:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] snapshot: 2625dcb1-d819-4ab5-a38c-39e9ccbbef36, volume: 53cf3013-3c91-4b05-9053-42d960e59340, {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 16:18:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:18:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:18:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:18:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:18:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0abb7bc3-206c-4d99-92c9-51b78e24bcb9 tempest-VolumesActionsTest-97128112 None] Lock "cinder-21ca09ee-e194-4745-a767-9b54c14616ef-detach_volume" acquired by "detach_volume" :: waited 0.107s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:18:13 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0abb7bc3-206c-4d99-92c9-51b78e24bcb9 tempest-VolumesActionsTest-97128112 None] Detaching volume 21ca09ee-e194-4745-a767-9b54c14616ef from instance 367efe6f-2468-4bed-bc37-a2907a97c6ec. Jun 02 16:18:13 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c0003a-9062-4d07-b94e-873a48b628af]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:18:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:13 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0abb7bc3-206c-4d99-92c9-51b78e24bcb9 tempest-VolumesActionsTest-97128112 None] Detach volume completed successfully. Jun 02 16:18:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0abb7bc3-206c-4d99-92c9-51b78e24bcb9 tempest-VolumesActionsTest-97128112 None] Lock "cinder-21ca09ee-e194-4745-a767-9b54c14616ef-detach_volume" released by "detach_volume" :: held 0.198s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:18:13 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36 Jun 02 16:18:13 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:13 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.956s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:13 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:18:13 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] Deleted volume successfully. Jun 02 16:18:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4a2560ea-91b9-43f7-b98b-8e2abc56cf74 tempest-SnapshotsActionsTest-616938903 None] Lock "cinder-ec79a0bb-35d4-4719-ba9e-05205a94a859-delete_volume" released by "delete_volume" :: held 3.948s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:18:14 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36" returned: 0 in 1.281s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de345f75-a3fd-4941-930c-bc6223da072e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:18:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 16:18:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Creating direct copy from snapshot {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 16:18:14 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d89a110-4872-4e06-bda9-a22396dd2ca2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:18:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:14 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e Jun 02 16:18:14 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:15 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e" returned: 0 in 1.188s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:15 devstack cinder-volume[86488]: DEBUG cinder.utils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Path /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-53cf3013-3c91-4b05-9053-42d960e59340 not found in is_blk_device check {{(pid=86488) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 16:18:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-53cf3013-3c91-4b05-9053-42d960e59340 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:15 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-53cf3013-3c91-4b05-9053-42d960e59340 Jun 02 16:18:15 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:22 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-53cf3013-3c91-4b05-9053-42d960e59340" returned: 0 in 6.844s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:22 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4893d4-ab95-4345-89b8-513d65e2f173]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:18:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:22 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e Jun 02 16:18:22 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:23 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e" returned: 0 in 1.055s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:23 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Image conversion details: src /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-53cf3013-3c91-4b05-9053-42d960e59340 {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:18:23 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Converted 1024.00 MB image at 149.54 MB/s Jun 02 16:18:23 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-53cf3013-3c91-4b05-9053-42d960e59340 is being set with open permissions: ugo+rw: NotImplementedError Jun 02 16:18:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-53cf3013-3c91-4b05-9053-42d960e59340 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:23 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-53cf3013-3c91-4b05-9053-42d960e59340 Jun 02 16:18:23 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:24 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-53cf3013-3c91-4b05-9053-42d960e59340" returned: 0 in 0.652s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Lock "cinder-quobyte-53cf3013-3c91-4b05-9053-42d960e59340" released by "_copy_volume_from_snapshot" :: held 11.221s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:18:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Acquiring lock "cinder-quobyte-2625dcb1-d819-4ab5-a38c-39e9ccbbef36" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:18:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Lock "cinder-quobyte-2625dcb1-d819-4ab5-a38c-39e9ccbbef36" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:18:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Deleting offline snapshot 2625dcb1-d819-4ab5-a38c-39e9ccbbef36 of volume de345f75-a3fd-4941-930c-bc6223da072e {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:18:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] snapshot_file for this snap is: volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:18:24 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92b723c-6c20-4b60-8175-2a87ec62ed64]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:18:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:24 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36 Jun 02 16:18:24 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-18c48339-8142-4a17-9aee-1a31ecb4e1b5 tempest-VolumesActionsTest-97128112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:25 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36" returned: 0 in 0.836s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de345f75-a3fd-4941-930c-bc6223da072e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:18:25 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c3ae8d-414d-4300-8409-95f306b1504e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:18:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:25 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e Jun 02 16:18:25 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:26 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e" returned: 0 in 0.810s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:26 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36 Jun 02 16:18:26 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:26 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36" returned: 0 in 0.810s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:26 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36 Jun 02 16:18:26 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:27 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e.2625dcb1-d819-4ab5-a38c-39e9ccbbef36" returned: 0 in 0.673s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:27 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Lock "cinder-quobyte-2625dcb1-d819-4ab5-a38c-39e9ccbbef36" released by "_delete_snapshot" :: held 3.263s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:18:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.786s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:18:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-18c48339-8142-4a17-9aee-1a31ecb4e1b5 tempest-VolumesActionsTest-97128112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:18:27 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[58107e76-daf0-489a-b320-1c79a0815974]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:18:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18c48339-8142-4a17-9aee-1a31ecb4e1b5 tempest-VolumesActionsTest-97128112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:27 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f88246f6-782a-4f1e-ad3c-b1e7380cd96e tempest-GroupsV314Test-684910249 None] Create group from source-group-78ba22f6-44fc-420f-8278-85ff465f0d58 completed successfully. Jun 02 16:18:27 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef Jun 02 16:18:27 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:28 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18c48339-8142-4a17-9aee-1a31ecb4e1b5 tempest-VolumesActionsTest-97128112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef" returned: 0 in 0.855s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:28 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[efffdad5-7ee9-4fe7-b480-cb5d820a7a2d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:18:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18c48339-8142-4a17-9aee-1a31ecb4e1b5 tempest-VolumesActionsTest-97128112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] Acquiring lock "cinder-quobyte-53cf3013-3c91-4b05-9053-42d960e59340" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:18:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] Lock "cinder-quobyte-53cf3013-3c91-4b05-9053-42d960e59340" acquired by "delete_volume" :: waited 0.031s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:18:28 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef Jun 02 16:18:28 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:28 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba507a52-92d2-43ee-b4cb-2334cc165fa2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:18:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-53cf3013-3c91-4b05-9053-42d960e59340 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:28 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-53cf3013-3c91-4b05-9053-42d960e59340 Jun 02 16:18:28 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:29 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18c48339-8142-4a17-9aee-1a31ecb4e1b5 tempest-VolumesActionsTest-97128112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef" returned: 0 in 0.934s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18c48339-8142-4a17-9aee-1a31ecb4e1b5 tempest-VolumesActionsTest-97128112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.2e0dbc81-d631-431f-b9cd-8778f961d2dfx58v3sau.img {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:29 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.2e0dbc81-d631-431f-b9cd-8778f961d2dfx58v3sau.img Jun 02 16:18:29 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:29 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-53cf3013-3c91-4b05-9053-42d960e59340" returned: 0 in 0.881s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-53cf3013-3c91-4b05-9053-42d960e59340 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:29 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-53cf3013-3c91-4b05-9053-42d960e59340 Jun 02 16:18:29 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:30 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-53cf3013-3c91-4b05-9053-42d960e59340" returned: 0 in 1.038s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:30 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] Lock "cinder-quobyte-53cf3013-3c91-4b05-9053-42d960e59340" released by "delete_volume" :: held 2.025s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:18:30 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] Created reservations ['f5bccf99-eb63-48b7-823a-45c7c993deb8'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:18:31 devstack cinder-volume[86488]: WARNING cinder.quota [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1716666893 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1716666893, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:18:31 devstack cinder-volume[86488]: WARNING cinder.quota [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1716666893 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1716666893, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:18:31 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] Created reservations ['b1e0f27e-708f-4141-a546-df55eb75e16c', '29232e40-e891-4d61-a811-a39015add88a', '3fa434ed-18a3-4cd1-bf02-9d9cf7549e04', 'f79932b9-5064-49b9-9e8d-ef53a1f2f8e0'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:18:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:18:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:18:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:18:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:18:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:31 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:18:31 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:33 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.583s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:33 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:18:33 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-bab6863d-16d6-4f08-83e9-0d3abc03ef2b tempest-GroupsV314Test-684910249 None] Delete group completed successfully. Jun 02 16:18:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] Acquiring lock "cinder-quobyte-de345f75-a3fd-4941-930c-bc6223da072e" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:18:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] Lock "cinder-quobyte-de345f75-a3fd-4941-930c-bc6223da072e" acquired by "delete_volume" :: waited 0.056s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:18:33 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5510bf95-12c9-4e36-8508-75d5bd53ef3b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:18:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:33 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e Jun 02 16:18:33 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:35 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e" returned: 0 in 2.038s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:35 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e Jun 02 16:18:35 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:35 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18c48339-8142-4a17-9aee-1a31ecb4e1b5 tempest-VolumesActionsTest-97128112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.2e0dbc81-d631-431f-b9cd-8778f961d2dfx58v3sau.img" returned: 0 in 6.432s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:35 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9641ce08-cf84-4513-b461-76753d0c49aa]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:18:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18c48339-8142-4a17-9aee-1a31ecb4e1b5 tempest-VolumesActionsTest-97128112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:36 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef Jun 02 16:18:36 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:36 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-de345f75-a3fd-4941-930c-bc6223da072e" returned: 0 in 0.948s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] Lock "cinder-quobyte-de345f75-a3fd-4941-930c-bc6223da072e" released by "delete_volume" :: held 3.170s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:18:36 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=86,cinder:INSERT=30,cinder:UPDATE=95,cinder:DELETE=3 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:18:36 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] Created reservations ['7968db79-695d-4e7e-b5fe-7a0bdaf44c2f'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:18:36 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] Created reservations ['d7e3468d-69fd-4e6e-a69b-570096ea1bfb', '2a1f21c8-b22c-4971-b057-611d33795422', 'f843a785-5cb7-4efb-896f-1a7421aed874', '2560931c-d7bb-490b-82b3-acb2376565b7'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:18:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:18:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:18:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:18:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:18:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:36 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:18:36 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:37 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-18c48339-8142-4a17-9aee-1a31ecb4e1b5 tempest-VolumesActionsTest-97128112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef" returned: 0 in 1.065s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:37 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-18c48339-8142-4a17-9aee-1a31ecb4e1b5 tempest-VolumesActionsTest-97128112 None] Image conversion details: src /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.2e0dbc81-d631-431f-b9cd-8778f961d2dfx58v3sau.img {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:18:37 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-18c48339-8142-4a17-9aee-1a31ecb4e1b5 tempest-VolumesActionsTest-97128112 None] Converted 1024.00 MB image at 159.18 MB/s Jun 02 16:18:37 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-18c48339-8142-4a17-9aee-1a31ecb4e1b5 tempest-VolumesActionsTest-97128112 None] 2e0dbc81-d631-431f-b9cd-8778f961d2df was raw, no need to convert to raw {{(pid=86488) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Jun 02 16:18:37 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.758s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:37 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:18:37 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-d9790216-340b-42b0-a54e-8eb79aaa635a tempest-GroupsV314Test-684910249 None] Delete group completed successfully. Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Flow 'volume_create_manager' (92e8f02f-bc72-4a02-b6d7-698e10b14ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11eec9fd-2d1b-4d9e-8277-6b924f77d250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11eec9fd-2d1b-4d9e-8277-6b924f77d250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1989938826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db398a3b-b0f3-46fc-85f3-8a99454d14c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3632df9ca154317b51b04ed17d9ec56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:18:38Z,use_quota=True,user_id='96e8e41a016f4e5eb2408654522692e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63e6eae-5b34-4482-88a7-b5535d1658a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63e6eae-5b34-4482-88a7-b5535d1658a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e5197f-cf45-4e0e-b2a6-4bcb84215f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e5197f-cf45-4e0e-b2a6-4bcb84215f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db398a3b-b0f3-46fc-85f3-8a99454d14c6', 'volume_name': 'volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56614eda-1579-4c22-b293-d7d40969fd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56614eda-1579-4c22-b293-d7d40969fd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ef6ef6-6c54-48be-82a4-b355be440a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:38 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Volume db398a3b-b0f3-46fc-85f3-8a99454d14c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6', 'volume_size': 1} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Flow 'volume_create_manager' (4958c7e5-4058-40f3-9342-cd60d2b89244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b6aa83-46bd-410b-b7c2-30b203c74b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b6aa83-46bd-410b-b7c2-30b203c74b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1253239616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1208003-4bcb-4067-84d9-9253c0873c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2cb340d54d4411bb9ff46d708ea4882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:18:39Z,use_quota=True,user_id='24685b1d18424b2082c69ce7edeccd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516ebbca-459b-4444-b2db-29f2de8590d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516ebbca-459b-4444-b2db-29f2de8590d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7575e5-0dea-4fc1-84ed-0415401b2f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7575e5-0dea-4fc1-84ed-0415401b2f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1208003-4bcb-4067-84d9-9253c0873c7b', 'volume_name': 'volume-d1208003-4bcb-4067-84d9-9253c0873c7b', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8e0137-2196-4a1c-8f2c-30b5d4147e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8e0137-2196-4a1c-8f2c-30b5d4147e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6ae1f4-1b2f-4f6e-9619-25938d8c1192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:38 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Volume d1208003-4bcb-4067-84d9-9253c0873c7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1208003-4bcb-4067-84d9-9253c0873c7b', 'volume_size': 1} Jun 02 16:18:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:48 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=67,cinder:UPDATE=61,cinder:DELETE=2,cinder:INSERT=13 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:18:48 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=11,cinder:INSERT=2,cinder:UPDATE=10 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:18:50 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:18:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Flow 'volume_create_manager' (bea929e9-92d6-45ac-87a5-254c6fd0540a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:18:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cfa0d55-05ea-49b6-b252-4df0c8cc8b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cfa0d55-05ea-49b6-b252-4df0c8cc8b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-848016769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857044a3-26f0-4b29-b544-b477416f2f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcb122e80d974c428ebd823d4940f3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:18:50Z,use_quota=True,user_id='8668672dd9e84a6abebab78e9b347cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9fec4b-3d15-44eb-991a-21dcb7d619cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9fec4b-3d15-44eb-991a-21dcb7d619cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2db6115-50a5-40fa-b6b4-e1e2e37e77d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2db6115-50a5-40fa-b6b4-e1e2e37e77d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '857044a3-26f0-4b29-b544-b477416f2f2d', 'volume_name': 'volume-857044a3-26f0-4b29-b544-b477416f2f2d', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1baec7b9-f7ed-42fc-96a8-1de579c539f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1baec7b9-f7ed-42fc-96a8-1de579c539f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9af7c4-cced-4893-acab-e087b9734733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:50 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Volume 857044a3-26f0-4b29-b544-b477416f2f2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-857044a3-26f0-4b29-b544-b477416f2f2d', 'volume_size': 1} Jun 02 16:18:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-18c48339-8142-4a17-9aee-1a31ecb4e1b5 tempest-VolumesActionsTest-97128112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.506s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:18:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-18c48339-8142-4a17-9aee-1a31ecb4e1b5 tempest-VolumesActionsTest-97128112 None] Uploaded volume to glance image-id: 2e0dbc81-d631-431f-b9cd-8778f961d2df. {{(pid=86488) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 02 16:18:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.914s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:18:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1989938826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db398a3b-b0f3-46fc-85f3-8a99454d14c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3632df9ca154317b51b04ed17d9ec56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:18:38Z,use_quota=True,user_id='96e8e41a016f4e5eb2408654522692e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:18:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Creating volume db398a3b-b0f3-46fc-85f3-8a99454d14c6 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:18:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:18:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:18:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:18:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:18:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:18:57 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:18:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:57 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6 1073741824 Jun 02 16:18:57 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:57 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-18c48339-8142-4a17-9aee-1a31ecb4e1b5 tempest-VolumesActionsTest-97128112 None] Copy volume to image completed successfully. Jun 02 16:18:57 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6 1073741824" returned: 0 in 0.771s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:58 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6 Jun 02 16:18:58 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:58 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6" returned: 0 in 0.586s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:18:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:18:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.627s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:18:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1253239616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1208003-4bcb-4067-84d9-9253c0873c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2cb340d54d4411bb9ff46d708ea4882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:18:39Z,use_quota=True,user_id='24685b1d18424b2082c69ce7edeccd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:18:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Creating volume d1208003-4bcb-4067-84d9-9253c0873c7b {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:18:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:18:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:18:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:18:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:18:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:18:58 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:18:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d1208003-4bcb-4067-84d9-9253c0873c7b 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ef6ef6-6c54-48be-82a4-b355be440a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:58 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d1208003-4bcb-4067-84d9-9253c0873c7b 1073741824 Jun 02 16:18:58 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0f6b33-ce64-474c-ac7c-914d825a5ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:18:58 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Volume volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6 (db398a3b-b0f3-46fc-85f3-8a99454d14c6): created successfully Jun 02 16:18:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0f6b33-ce64-474c-ac7c-914d825a5ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:18:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Flow 'volume_create_manager' (92e8f02f-bc72-4a02-b6d7-698e10b14ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:18:58 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0357b56e-ec45-484b-b58a-11d045cf36dd tempest-SnapshotMetadataTestJSON-1653633891 None] Created volume successfully. Jun 02 16:18:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:59 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d1208003-4bcb-4067-84d9-9253c0873c7b 1073741824" returned: 0 in 0.765s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d1208003-4bcb-4067-84d9-9253c0873c7b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:18:59 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d1208003-4bcb-4067-84d9-9253c0873c7b Jun 02 16:18:59 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:18:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:18:59 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jun 02 16:18:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d1208003-4bcb-4067-84d9-9253c0873c7b" returned: 0 in 0.609s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:18:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:18:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:18:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.714s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-848016769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857044a3-26f0-4b29-b544-b477416f2f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcb122e80d974c428ebd823d4940f3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:18:50Z,use_quota=True,user_id='8668672dd9e84a6abebab78e9b347cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Creating volume 857044a3-26f0-4b29-b544-b477416f2f2d {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:19:00 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-857044a3-26f0-4b29-b544-b477416f2f2d 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:00 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-857044a3-26f0-4b29-b544-b477416f2f2d 1073741824 Jun 02 16:19:00 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6ae1f4-1b2f-4f6e-9619-25938d8c1192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1208003-4bcb-4067-84d9-9253c0873c7b', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8509dda8-a386-45e8-99f3-96723a1fd0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:00 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Volume volume-d1208003-4bcb-4067-84d9-9253c0873c7b (d1208003-4bcb-4067-84d9-9253c0873c7b): created successfully Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8509dda8-a386-45e8-99f3-96723a1fd0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Flow 'volume_create_manager' (4958c7e5-4058-40f3-9342-cd60d2b89244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:00 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-c4c46a83-eef2-4e4e-ae34-e377edb8c957 tempest-VolumesListAdminTestJSON-1102822967 None] Created volume successfully. Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:00 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:19:00 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:00 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.659s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Flow 'volume_create_manager' (c8a3188a-bad2-48f0-a177-f4c95ddaf358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a68c5dc-d6be-4d63-a02c-0decbd7e5be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a68c5dc-d6be-4d63-a02c-0decbd7e5be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-813198878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c288853-1b6d-440c-b22c-93e4e6f83eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2cb340d54d4411bb9ff46d708ea4882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:19:01Z,use_quota=True,user_id='24685b1d18424b2082c69ce7edeccd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a33f30-aa07-47ca-99f0-57a868f868de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a33f30-aa07-47ca-99f0-57a868f868de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee8f338-8a47-4e6f-8fc3-dcbf95e1a5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee8f338-8a47-4e6f-8fc3-dcbf95e1a5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c288853-1b6d-440c-b22c-93e4e6f83eba', 'volume_name': 'volume-8c288853-1b6d-440c-b22c-93e4e6f83eba', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad77e1d5-9d6e-44cf-8498-b1393e21f97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad77e1d5-9d6e-44cf-8498-b1393e21f97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec325a63-c523-4779-8653-0cfaea61fd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:00 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Volume 8c288853-1b6d-440c-b22c-93e4e6f83eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c288853-1b6d-440c-b22c-93e4e6f83eba', 'volume_size': 1} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:00 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-857044a3-26f0-4b29-b544-b477416f2f2d 1073741824" returned: 0 in 0.883s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-857044a3-26f0-4b29-b544-b477416f2f2d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:00 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-857044a3-26f0-4b29-b544-b477416f2f2d Jun 02 16:19:00 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:01 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-857044a3-26f0-4b29-b544-b477416f2f2d" returned: 0 in 0.576s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:19:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.470s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9af7c4-cced-4893-acab-e087b9734733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857044a3-26f0-4b29-b544-b477416f2f2d', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c1241d-d72d-43db-922e-46b23d260356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:01 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[db06f442-7446-486d-9136-f768f65a2e9e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:01 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Volume volume-857044a3-26f0-4b29-b544-b477416f2f2d (857044a3-26f0-4b29-b544-b477416f2f2d): created successfully Jun 02 16:19:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c1241d-d72d-43db-922e-46b23d260356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Flow 'volume_create_manager' (bea929e9-92d6-45ac-87a5-254c6fd0540a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:01 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-4fcd608e-f242-4e74-a854-83efd748b4b2 tempest-VolumeQuotasAdminTestJSON-155282593 None] Created volume successfully. Jun 02 16:19:01 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef Jun 02 16:19:01 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:01 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] Acquiring lock "cinder-857044a3-26f0-4b29-b544-b477416f2f2d-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:02 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] Lock "cinder-857044a3-26f0-4b29-b544-b477416f2f2d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:02 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] Acquiring lock "cinder-quobyte-857044a3-26f0-4b29-b544-b477416f2f2d" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:02 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] Lock "cinder-quobyte-857044a3-26f0-4b29-b544-b477416f2f2d" acquired by "delete_volume" :: waited 0.017s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:02 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[934e4d1d-594b-42e8-911a-bb9a073c2f35]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-857044a3-26f0-4b29-b544-b477416f2f2d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:02 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-857044a3-26f0-4b29-b544-b477416f2f2d Jun 02 16:19:02 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:02 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef" returned: 0 in 0.709s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:02 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3571fb9a-1010-4594-8726-2f7c8238bdcc]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:02 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef Jun 02 16:19:02 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:02 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-857044a3-26f0-4b29-b544-b477416f2f2d" returned: 0 in 0.708s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-857044a3-26f0-4b29-b544-b477416f2f2d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:02 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-857044a3-26f0-4b29-b544-b477416f2f2d Jun 02 16:19:02 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:02 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef" returned: 0 in 0.727s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.49c42132-21e4-441d-9fd1-f7ddddf474489khbbtqs.img {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:03 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.49c42132-21e4-441d-9fd1-f7ddddf474489khbbtqs.img Jun 02 16:19:03 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:03 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-857044a3-26f0-4b29-b544-b477416f2f2d" returned: 0 in 0.631s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:03 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] Lock "cinder-quobyte-857044a3-26f0-4b29-b544-b477416f2f2d" released by "delete_volume" :: held 1.385s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:03 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] Created reservations ['ce546211-9413-408b-aba3-cb71199cd577', '72710aec-e095-44aa-be30-5ca8d6a9349c', '56815978-257b-4006-96ce-03bfaa2b011a', '5157127c-a540-4fd0-972a-0c9d062fd58b'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:19:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:03 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:19:03 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:04 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.052s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:04 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:19:04 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] Deleted volume successfully. Jun 02 16:19:04 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6ceb326b-7a87-4232-a477-79e6898d8ab3 tempest-VolumeQuotasAdminTestJSON-155282593 None] Lock "cinder-857044a3-26f0-4b29-b544-b477416f2f2d-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:05 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:19:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Flow 'volume_create_manager' (e0c1d872-2f5f-4e60-bd50-e5abb0c612f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99124d1d-d847-4878-aab2-f78abc96f6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99124d1d-d847-4878-aab2-f78abc96f6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-934807265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d0d380-5540-4eb1-9549-607aea1fea1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcb122e80d974c428ebd823d4940f3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:19:05Z,use_quota=True,user_id='8668672dd9e84a6abebab78e9b347cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e6fe86-f162-4ad0-8ee5-28a73cbbd0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e6fe86-f162-4ad0-8ee5-28a73cbbd0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd18356-9608-490e-956f-42f62631fcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd18356-9608-490e-956f-42f62631fcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4d0d380-5540-4eb1-9549-607aea1fea1c', 'volume_name': 'volume-a4d0d380-5540-4eb1-9549-607aea1fea1c', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d337ddf6-db48-4057-b158-c14b20c95961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d337ddf6-db48-4057-b158-c14b20c95961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f08d67-4614-48db-b40f-71f6f10e5b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:05 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Volume a4d0d380-5540-4eb1-9549-607aea1fea1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4d0d380-5540-4eb1-9549-607aea1fea1c', 'volume_size': 1} Jun 02 16:19:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:07 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.49c42132-21e4-441d-9fd1-f7ddddf474489khbbtqs.img" returned: 0 in 4.851s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:07 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae8a8ff-79e9-40b8-b131-c618d33c79bb]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:07 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef Jun 02 16:19:07 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:08 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef" returned: 0 in 0.799s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:08 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] Image conversion details: src /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef, size 1024.00 MB, duration 4.85 sec, destination /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.49c42132-21e4-441d-9fd1-f7ddddf474489khbbtqs.img {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:19:08 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] Converted 1024.00 MB image at 211.05 MB/s Jun 02 16:19:08 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] 49c42132-21e4-441d-9fd1-f7ddddf47448 was raw, converting to qcow2 {{(pid=86488) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Jun 02 16:19:08 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecf25be-cadf-43b8-a746-9ffdc5bbb384]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.49c42132-21e4-441d-9fd1-f7ddddf474489khbbtqs.img {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:08 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.49c42132-21e4-441d-9fd1-f7ddddf474489khbbtqs.img Jun 02 16:19:08 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:09 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.49c42132-21e4-441d-9fd1-f7ddddf474489khbbtqs.img" returned: 0 in 0.668s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.49c42132-21e4-441d-9fd1-f7ddddf474489khbbtqs.img {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:09 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.49c42132-21e4-441d-9fd1-f7ddddf474489khbbtqs.img Jun 02 16:19:09 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:09 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.49c42132-21e4-441d-9fd1-f7ddddf474489khbbtqs.img" returned: 1 in 0.652s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.49c42132-21e4-441d-9fd1-f7ddddf474489khbbtqs.img' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:19:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.49c42132-21e4-441d-9fd1-f7ddddf474489khbbtqs.img /opt/stack/data/cinder/conversion/vol_upload_sg9_3pls {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:10 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.49c42132-21e4-441d-9fd1-f7ddddf474489khbbtqs.img /opt/stack/data/cinder/conversion/vol_upload_sg9_3pls Jun 02 16:19:10 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:10 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.49c42132-21e4-441d-9fd1-f7ddddf474489khbbtqs.img /opt/stack/data/cinder/conversion/vol_upload_sg9_3pls" returned: 0 in 0.596s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:10 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] Image conversion details: src /opt/stack/data/cinder/conversion/21ca09ee-e194-4745-a767-9b54c14616ef.temp_image.49c42132-21e4-441d-9fd1-f7ddddf474489khbbtqs.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_sg9_3pls {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:19:10 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 02 16:19:10 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cef55c7-795f-46f7-af2f-d1a665dd5cca]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sg9_3pls {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:10 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sg9_3pls Jun 02 16:19:10 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:11 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sg9_3pls" returned: 0 in 0.656s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.965s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:12 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] Uploaded volume to glance image-id: 49c42132-21e4-441d-9fd1-f7ddddf47448. {{(pid=86488) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 02 16:19:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.705s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:12 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] Creating offline snapshot 29e4cc20-5529-4f8b-ab43-b883e8365026 of volume db398a3b-b0f3-46fc-85f3-8a99454d14c6 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:19:12 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-dbc4dd24-d6d2-46b3-88cc-d566c84885da tempest-VolumesActionsTest-97128112 None] Copy volume to image completed successfully. Jun 02 16:19:12 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f6aef5-71de-4086-b23f-cfce566256ae]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:12 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6 Jun 02 16:19:12 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:13 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6" returned: 0 in 0.713s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:13 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026 1G Jun 02 16:19:13 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] Acquiring lock "cinder-21ca09ee-e194-4745-a767-9b54c14616ef-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] Lock "cinder-21ca09ee-e194-4745-a767-9b54c14616ef-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] Acquiring lock "cinder-quobyte-21ca09ee-e194-4745-a767-9b54c14616ef" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] Lock "cinder-quobyte-21ca09ee-e194-4745-a767-9b54c14616ef" acquired by "delete_volume" :: waited 0.016s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:13 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a553865c-0a09-46d6-aa11-0528841f1ed7]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:13 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef Jun 02 16:19:13 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:13 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026 1G" returned: 0 in 0.772s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:14 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026 Jun 02 16:19:14 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:14 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef" returned: 0 in 0.724s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:14 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef Jun 02 16:19:14 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:14 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026" returned: 0 in 0.666s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:14 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026 is being set with open permissions: ugo+rw Jun 02 16:19:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:14 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026 Jun 02 16:19:14 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:14 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21ca09ee-e194-4745-a767-9b54c14616ef" returned: 0 in 0.597s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] Lock "cinder-quobyte-21ca09ee-e194-4745-a767-9b54c14616ef" released by "delete_volume" :: held 1.366s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:14 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] Created reservations ['fd232015-41f2-4b04-95b0-a6fcb050cc68', '8f4bce17-e0d0-4605-83aa-ac554d628035', '3e2dc040-60a0-447d-bf87-39b5b3ffb65e', '3a62cc4d-a800-4985-8460-9389e55fbb4a'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:19:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:14 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:19:14 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:15 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026" returned: 0 in 0.591s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:15 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.info Jun 02 16:19:15 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:15 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.596s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:15 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:19:15 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] Deleted volume successfully. Jun 02 16:19:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5b69ac4a-a33b-4050-a18c-e4e323f2da54 tempest-VolumesActionsTest-97128112 None] Lock "cinder-21ca09ee-e194-4745-a767-9b54c14616ef-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:15 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.info" returned: 0 in 0.684s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:15 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.info is being set with open permissions: ugo+rw Jun 02 16:19:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:16 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.info Jun 02 16:19:16 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:16 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.info" returned: 0 in 0.626s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.153s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.764s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-813198878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c288853-1b6d-440c-b22c-93e4e6f83eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2cb340d54d4411bb9ff46d708ea4882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:19:01Z,use_quota=True,user_id='24685b1d18424b2082c69ce7edeccd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:19:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Creating volume 8c288853-1b6d-440c-b22c-93e4e6f83eba {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:19:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:19:16 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:19:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8c288853-1b6d-440c-b22c-93e4e6f83eba 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:16 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8c288853-1b6d-440c-b22c-93e4e6f83eba 1073741824 Jun 02 16:19:16 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:16 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-5095e7cc-45e5-488e-bd02-b83d851b6131 tempest-SnapshotMetadataTestJSON-1653633891 None] Create snapshot completed successfully Jun 02 16:19:17 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8c288853-1b6d-440c-b22c-93e4e6f83eba 1073741824" returned: 0 in 0.823s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8c288853-1b6d-440c-b22c-93e4e6f83eba {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:17 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8c288853-1b6d-440c-b22c-93e4e6f83eba Jun 02 16:19:17 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:18 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8c288853-1b6d-440c-b22c-93e4e6f83eba" returned: 0 in 0.693s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.874s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-934807265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d0d380-5540-4eb1-9549-607aea1fea1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcb122e80d974c428ebd823d4940f3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:19:05Z,use_quota=True,user_id='8668672dd9e84a6abebab78e9b347cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Creating volume a4d0d380-5540-4eb1-9549-607aea1fea1c {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:19:18 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a4d0d380-5540-4eb1-9549-607aea1fea1c 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:18 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a4d0d380-5540-4eb1-9549-607aea1fea1c 1073741824 Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec325a63-c523-4779-8653-0cfaea61fd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c288853-1b6d-440c-b22c-93e4e6f83eba', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:18 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd94c0a-1a1b-452f-a55e-320a0a066431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] Acquiring lock "cinder-29e4cc20-5529-4f8b-ab43-b883e8365026-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:18 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Volume volume-8c288853-1b6d-440c-b22c-93e4e6f83eba (8c288853-1b6d-440c-b22c-93e4e6f83eba): created successfully Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd94c0a-1a1b-452f-a55e-320a0a066431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Flow 'volume_create_manager' (c8a3188a-bad2-48f0-a177-f4c95ddaf358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "cinder-29e4cc20-5529-4f8b-ab43-b883e8365026-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] Acquiring lock "cinder-quobyte-db398a3b-b0f3-46fc-85f3-8a99454d14c6" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:18 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-787c8872-ef3b-4113-bbf6-aebac21a9840 tempest-VolumesListAdminTestJSON-1102822967 None] Created volume successfully. Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "cinder-quobyte-db398a3b-b0f3-46fc-85f3-8a99454d14c6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] Acquiring lock "cinder-quobyte-29e4cc20-5529-4f8b-ab43-b883e8365026" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "cinder-quobyte-29e4cc20-5529-4f8b-ab43-b883e8365026" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] Deleting offline snapshot 29e4cc20-5529-4f8b-ab43-b883e8365026 of volume db398a3b-b0f3-46fc-85f3-8a99454d14c6 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] snapshot_file for this snap is: volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c48d57-dbbf-4df2-9395-66ebc9847817]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:18 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026 Jun 02 16:19:18 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:19 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a4d0d380-5540-4eb1-9549-607aea1fea1c 1073741824" returned: 0 in 1.069s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a4d0d380-5540-4eb1-9549-607aea1fea1c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:19 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a4d0d380-5540-4eb1-9549-607aea1fea1c Jun 02 16:19:19 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:19 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026" returned: 0 in 0.934s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da79893-0ad9-4a02-896e-4302c139662d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:19 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6 Jun 02 16:19:19 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Flow 'volume_create_manager' (b56a8072-22f5-4585-a2f3-b4e1fb09ffd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466325f8-1c4c-494a-be56-0cd0f23385ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466325f8-1c4c-494a-be56-0cd0f23385ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-668231427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2545e3b9-8d8a-4f77-9188-1144e8497d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2cb340d54d4411bb9ff46d708ea4882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:19:20Z,use_quota=True,user_id='24685b1d18424b2082c69ce7edeccd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adeec62-f5a3-4213-b3eb-af99008a8278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adeec62-f5a3-4213-b3eb-af99008a8278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3555062c-d506-4975-a833-4b6e2a02c633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3555062c-d506-4975-a833-4b6e2a02c633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2545e3b9-8d8a-4f77-9188-1144e8497d78', 'volume_name': 'volume-2545e3b9-8d8a-4f77-9188-1144e8497d78', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40dfbcb8-7520-464d-a2db-c52117f4ab76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40dfbcb8-7520-464d-a2db-c52117f4ab76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8af3ef-1c57-4249-aa10-ce90a4bba4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:19 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Volume 2545e3b9-8d8a-4f77-9188-1144e8497d78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2545e3b9-8d8a-4f77-9188-1144e8497d78', 'volume_size': 1} Jun 02 16:19:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:20 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a4d0d380-5540-4eb1-9549-607aea1fea1c" returned: 0 in 0.707s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.189s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-668231427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2545e3b9-8d8a-4f77-9188-1144e8497d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2cb340d54d4411bb9ff46d708ea4882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:19:20Z,use_quota=True,user_id='24685b1d18424b2082c69ce7edeccd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Creating volume 2545e3b9-8d8a-4f77-9188-1144e8497d78 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:19:20 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2545e3b9-8d8a-4f77-9188-1144e8497d78 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:20 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2545e3b9-8d8a-4f77-9188-1144e8497d78 1073741824 Jun 02 16:19:20 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f08d67-4614-48db-b40f-71f6f10e5b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d0d380-5540-4eb1-9549-607aea1fea1c', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e086538-bf90-4200-b644-5ba756bb0ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:20 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Volume volume-a4d0d380-5540-4eb1-9549-607aea1fea1c (a4d0d380-5540-4eb1-9549-607aea1fea1c): created successfully Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e086538-bf90-4200-b644-5ba756bb0ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Flow 'volume_create_manager' (e0c1d872-2f5f-4e60-bd50-e5abb0c612f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:20 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-236a6e8e-19ad-45a4-b722-54f7296717de tempest-VolumeQuotasAdminTestJSON-155282593 None] Created volume successfully. Jun 02 16:19:20 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6" returned: 0 in 0.941s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:20 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026 Jun 02 16:19:20 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:21 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2545e3b9-8d8a-4f77-9188-1144e8497d78 1073741824" returned: 0 in 0.890s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2545e3b9-8d8a-4f77-9188-1144e8497d78 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:21 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2545e3b9-8d8a-4f77-9188-1144e8497d78 Jun 02 16:19:21 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:21 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026" returned: 0 in 0.784s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:21 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026 Jun 02 16:19:21 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:21 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2545e3b9-8d8a-4f77-9188-1144e8497d78" returned: 0 in 0.678s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:19:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8af3ef-1c57-4249-aa10-ce90a4bba4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2545e3b9-8d8a-4f77-9188-1144e8497d78', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb53cdc8-93b3-4f26-ad30-413942a67f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:21 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Volume volume-2545e3b9-8d8a-4f77-9188-1144e8497d78 (2545e3b9-8d8a-4f77-9188-1144e8497d78): created successfully Jun 02 16:19:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb53cdc8-93b3-4f26-ad30-413942a67f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Flow 'volume_create_manager' (b56a8072-22f5-4585-a2f3-b4e1fb09ffd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:21 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f77a1c4f-754a-463c-b33c-2e86e0b6297a tempest-VolumesListAdminTestJSON-1102822967 None] Created volume successfully. Jun 02 16:19:21 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6.29e4cc20-5529-4f8b-ab43-b883e8365026" returned: 0 in 0.783s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:21 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "cinder-quobyte-29e4cc20-5529-4f8b-ab43-b883e8365026" released by "_delete_snapshot" :: held 3.617s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:21 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "cinder-quobyte-db398a3b-b0f3-46fc-85f3-8a99454d14c6" released by "delete_snapshot" :: held 3.654s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] Created reservations ['c72f8e1d-95af-43f6-bf1b-4913039da36d', 'faf324b2-043a-4f78-a1e3-38cd5d4ba680', '57de509a-bb9d-41e4-bc8b-fb0651134bc8', 'fa574be5-2a88-48af-861a-d73a3fe66c49'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Flow 'volume_create_manager' (65ad6718-3e13-4dce-9d0a-525698607240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe7625a-63c1-4a98-a4f6-6c2a950caf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe7625a-63c1-4a98-a4f6-6c2a950caf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1268323615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd39896a-1c3d-46da-a091-eebbfcbd660e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b654c8641b3349a4a5b4a433c32acecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:19:22Z,use_quota=True,user_id='7f11caa2e6614d26944c7e720faaed5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9128762-9e47-40b2-bcd7-7921c8300870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9128762-9e47-40b2-bcd7-7921c8300870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd768a2f-f8c9-448c-a04e-20307e767e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd768a2f-f8c9-448c-a04e-20307e767e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd39896a-1c3d-46da-a091-eebbfcbd660e', 'volume_name': 'volume-cd39896a-1c3d-46da-a091-eebbfcbd660e', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0877454b-1968-4518-8eb7-e17aacd3f144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0877454b-1968-4518-8eb7-e17aacd3f144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b881f23-d9d6-4bb8-bb18-e519a0b80531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:22 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Volume cd39896a-1c3d-46da-a091-eebbfcbd660e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd39896a-1c3d-46da-a091-eebbfcbd660e', 'volume_size': 1} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1268323615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd39896a-1c3d-46da-a091-eebbfcbd660e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b654c8641b3349a4a5b4a433c32acecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:19:22Z,use_quota=True,user_id='7f11caa2e6614d26944c7e720faaed5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Creating volume cd39896a-1c3d-46da-a091-eebbfcbd660e {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:19:22 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:22 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e 1073741824 Jun 02 16:19:22 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-16ebc029-9ed3-4688-b02e-7b0bf747f7f5 tempest-VolumeQuotasAdminTestJSON-1032503533 None] Transfer volume completed successfully. Jun 02 16:19:22 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:22 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] Delete snapshot completed successfully. Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-936b62fb-b3e4-4fcf-ad60-55889f28cc81 tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "cinder-29e4cc20-5529-4f8b-ab43-b883e8365026-delete_snapshot" released by "delete_snapshot" :: held 3.963s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Flow 'volume_create_manager' (e7467a81-9e4b-4fa7-b2a1-6e9b9d7db6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf25a06-4172-49c1-b3c9-e0e7c25b6b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf25a06-4172-49c1-b3c9-e0e7c25b6b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ff8157-9b78-4183-a071-f8239854479a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6398a238b72c45c6b9a4cf0b57e6a8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:19:23Z,use_quota=True,user_id='8a831995125a47038e5835fdd086305c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504c9a3d-4eb2-45f3-b66e-68471fe1e049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504c9a3d-4eb2-45f3-b66e-68471fe1e049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1ca467-ece9-4e4c-8b98-29aa1cc36e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1ca467-ece9-4e4c-8b98-29aa1cc36e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ff8157-9b78-4183-a071-f8239854479a', 'volume_name': 'volume-15ff8157-9b78-4183-a071-f8239854479a', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20cd0ce-2d5c-42e2-8707-75b9a06ceb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20cd0ce-2d5c-42e2-8707-75b9a06ceb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc5e63f-99a1-47a9-a437-eb4e26395cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:22 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Volume 15ff8157-9b78-4183-a071-f8239854479a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ff8157-9b78-4183-a071-f8239854479a', 'volume_size': 1} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] Acquiring lock "cinder-db398a3b-b0f3-46fc-85f3-8a99454d14c6-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "cinder-db398a3b-b0f3-46fc-85f3-8a99454d14c6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] Acquiring lock "cinder-quobyte-db398a3b-b0f3-46fc-85f3-8a99454d14c6" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "cinder-quobyte-db398a3b-b0f3-46fc-85f3-8a99454d14c6" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caf4096-aadd-43bf-8a2f-d2acc920fbaa]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:23 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6 Jun 02 16:19:23 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] Acquiring lock "cinder-a4d0d380-5540-4eb1-9549-607aea1fea1c-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] Lock "cinder-a4d0d380-5540-4eb1-9549-607aea1fea1c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:23 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e 1073741824" returned: 0 in 1.028s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] Acquiring lock "cinder-quobyte-a4d0d380-5540-4eb1-9549-607aea1fea1c" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] Lock "cinder-quobyte-a4d0d380-5540-4eb1-9549-607aea1fea1c" acquired by "delete_volume" :: waited 0.024s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccbda6a-9c98-4b77-8bdb-5066938e7e1b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a4d0d380-5540-4eb1-9549-607aea1fea1c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:23 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e Jun 02 16:19:23 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:23 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a4d0d380-5540-4eb1-9549-607aea1fea1c Jun 02 16:19:23 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:23 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6" returned: 0 in 0.813s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:23 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6 Jun 02 16:19:23 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:23 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e" returned: 0 in 0.607s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.057s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ff8157-9b78-4183-a071-f8239854479a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6398a238b72c45c6b9a4cf0b57e6a8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:19:23Z,use_quota=True,user_id='8a831995125a47038e5835fdd086305c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Creating volume 15ff8157-9b78-4183-a071-f8239854479a {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:19:23 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-15ff8157-9b78-4183-a071-f8239854479a 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:23 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-15ff8157-9b78-4183-a071-f8239854479a 1073741824 Jun 02 16:19:23 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b881f23-d9d6-4bb8-bb18-e519a0b80531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd39896a-1c3d-46da-a091-eebbfcbd660e', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8605fa5a-f7b3-4f62-bade-ec6cff423fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:24 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Volume volume-cd39896a-1c3d-46da-a091-eebbfcbd660e (cd39896a-1c3d-46da-a091-eebbfcbd660e): created successfully Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8605fa5a-f7b3-4f62-bade-ec6cff423fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Flow 'volume_create_manager' (65ad6718-3e13-4dce-9d0a-525698607240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:24 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0455100a-2243-4feb-9d16-d8cda7eb23df tempest-VolumesCloneTest-212475240 None] Created volume successfully. Jun 02 16:19:24 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a4d0d380-5540-4eb1-9549-607aea1fea1c" returned: 0 in 0.826s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a4d0d380-5540-4eb1-9549-607aea1fea1c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:24 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a4d0d380-5540-4eb1-9549-607aea1fea1c Jun 02 16:19:24 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:24 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-db398a3b-b0f3-46fc-85f3-8a99454d14c6" returned: 0 in 0.641s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "cinder-quobyte-db398a3b-b0f3-46fc-85f3-8a99454d14c6" released by "delete_volume" :: held 1.527s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] Created reservations ['8baf4170-7567-4de0-ab7d-d77a65164bba', 'dec8aee7-c1aa-40d4-9adf-7473e8c52d3e', '7d7494a3-e54c-4d57-98c2-4b9e18bd46eb', 'aef3a71d-24d0-4d89-a678-7353745a8c24'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:24 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:19:24 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Flow 'volume_create_manager' (0aa4bfc8-0a43-4114-b0ee-9d8869945ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c35b42a-d224-4cae-8e98-ef5b9ccb8dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c35b42a-d224-4cae-8e98-ef5b9ccb8dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1675864015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb6cb67-aeaf-48c8-997a-b5008135b906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b654c8641b3349a4a5b4a433c32acecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:19:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=cd39896a-1c3d-46da-a091-eebbfcbd660e,status='creating',terminated_at=None,updated_at=2026-06-02T14:19:25Z,use_quota=True,user_id='7f11caa2e6614d26944c7e720faaed5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8642dbd-c5b2-4abf-a0a7-5b59a240ea5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8642dbd-c5b2-4abf-a0a7-5b59a240ea5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1336cd5-9cad-410c-98d2-b0344b491ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1336cd5-9cad-410c-98d2-b0344b491ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5fb6cb67-aeaf-48c8-997a-b5008135b906', 'volume_name': 'volume-5fb6cb67-aeaf-48c8-997a-b5008135b906', 'volume_size': 2, 'source_volid': 'cd39896a-1c3d-46da-a091-eebbfcbd660e', 'source_volstatus': 'available'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc2ce9a-87d9-4b81-b570-ca085816eb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc2ce9a-87d9-4b81-b570-ca085816eb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:24 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcbfa3b3-ccb3-4891-9461-18f80b5b23c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:24 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Volume 5fb6cb67-aeaf-48c8-997a-b5008135b906: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5fb6cb67-aeaf-48c8-997a-b5008135b906', 'volume_size': 2, 'source_volid': 'cd39896a-1c3d-46da-a091-eebbfcbd660e', 'source_volstatus': 'available'} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-15ff8157-9b78-4183-a071-f8239854479a 1073741824" returned: 0 in 0.991s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-15ff8157-9b78-4183-a071-f8239854479a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:24 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-15ff8157-9b78-4183-a071-f8239854479a Jun 02 16:19:25 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:25 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a4d0d380-5540-4eb1-9549-607aea1fea1c" returned: 0 in 0.927s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] Lock "cinder-quobyte-a4d0d380-5540-4eb1-9549-607aea1fea1c" released by "delete_volume" :: held 1.804s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] Created reservations ['0b2bb193-9bc1-456a-a5ca-21cd4ab7ff97', '71cc8f47-291d-4e1c-b997-b8e15de31e32', '1ba612dd-6fc7-4011-861b-132010f80f4e', '59422a89-3a43-4724-b1c5-f53ae220c904'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:25 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:19:25 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:25 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.695s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:19:25 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] Deleted volume successfully. Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-70bd2899-3636-494d-ae2a-15e0c93fbebb tempest-SnapshotMetadataTestJSON-1653633891 None] Lock "cinder-db398a3b-b0f3-46fc-85f3-8a99454d14c6-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:25 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-15ff8157-9b78-4183-a071-f8239854479a" returned: 0 in 0.750s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.779s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:25 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Cloning volume cd39896a-1c3d-46da-a091-eebbfcbd660e to volume 5fb6cb67-aeaf-48c8-997a-b5008135b906 Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc5e63f-99a1-47a9-a437-eb4e26395cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ff8157-9b78-4183-a071-f8239854479a', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f05cb7b-ffa9-41bf-b68a-84cbe37e514a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:25 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Volume volume-15ff8157-9b78-4183-a071-f8239854479a (15ff8157-9b78-4183-a071-f8239854479a): created successfully Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f05cb7b-ffa9-41bf-b68a-84cbe37e514a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Flow 'volume_create_manager' (e7467a81-9e4b-4fa7-b2a1-6e9b9d7db6ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:25 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-af5cbb3c-ce4c-4e86-b0e8-2b71b115129e tempest-VolumesListAdminTestJSON-548541341 None] Created volume successfully. Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Creating offline snapshot 44a7b82d-7b15-4da2-972d-b0b837ff4504 of volume cd39896a-1c3d-46da-a091-eebbfcbd660e {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de8460a-359d-414f-97f8-a8738dad5c74]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:25 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.701s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:25 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:19:25 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] Deleted volume successfully. Jun 02 16:19:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fa72bba7-ad4d-4426-b4e3-577067ba54d9 tempest-VolumeQuotasAdminTestJSON-759257886 None] Lock "cinder-a4d0d380-5540-4eb1-9549-607aea1fea1c-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:26 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e Jun 02 16:19:26 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] Acquiring lock "cinder-15ff8157-9b78-4183-a071-f8239854479a-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] Lock "cinder-15ff8157-9b78-4183-a071-f8239854479a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] Acquiring lock "cinder-quobyte-15ff8157-9b78-4183-a071-f8239854479a" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] Acquiring lock "cinder-2545e3b9-8d8a-4f77-9188-1144e8497d78-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] Lock "cinder-quobyte-15ff8157-9b78-4183-a071-f8239854479a" acquired by "delete_volume" :: waited 0.046s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "cinder-2545e3b9-8d8a-4f77-9188-1144e8497d78-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:26 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[92993923-c08c-4a39-873c-2cc927db94e4]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-15ff8157-9b78-4183-a071-f8239854479a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] Acquiring lock "cinder-quobyte-2545e3b9-8d8a-4f77-9188-1144e8497d78" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "cinder-quobyte-2545e3b9-8d8a-4f77-9188-1144e8497d78" acquired by "delete_volume" :: waited 0.023s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:26 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4467e0-97ab-496c-bf90-032a501cac9c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2545e3b9-8d8a-4f77-9188-1144e8497d78 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:26 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-15ff8157-9b78-4183-a071-f8239854479a Jun 02 16:19:26 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:26 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2545e3b9-8d8a-4f77-9188-1144e8497d78 Jun 02 16:19:26 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:26 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e" returned: 0 in 0.968s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:26 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504 1G Jun 02 16:19:26 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:27 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-15ff8157-9b78-4183-a071-f8239854479a" returned: 0 in 1.127s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-15ff8157-9b78-4183-a071-f8239854479a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:27 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-15ff8157-9b78-4183-a071-f8239854479a Jun 02 16:19:27 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:27 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2545e3b9-8d8a-4f77-9188-1144e8497d78" returned: 0 in 1.095s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2545e3b9-8d8a-4f77-9188-1144e8497d78 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:27 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2545e3b9-8d8a-4f77-9188-1144e8497d78 Jun 02 16:19:27 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:28 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504 1G" returned: 0 in 1.304s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd39896a-1c3d-46da-a091-eebbfcbd660e -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:28 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd39896a-1c3d-46da-a091-eebbfcbd660e -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504 Jun 02 16:19:28 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:28 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-15ff8157-9b78-4183-a071-f8239854479a" returned: 0 in 0.869s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] Lock "cinder-quobyte-15ff8157-9b78-4183-a071-f8239854479a" released by "delete_volume" :: held 2.085s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:28 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2545e3b9-8d8a-4f77-9188-1144e8497d78" returned: 0 in 0.849s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "cinder-quobyte-2545e3b9-8d8a-4f77-9188-1144e8497d78" released by "delete_volume" :: held 2.009s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] Created reservations ['c25d6ee1-3845-4411-9682-adc9c9dda2b0', 'ec0024b4-8829-439d-9947-74d5cafd90c4', '029c4c41-c0ec-486e-babc-22d1e82803cb', '3b1426db-afc2-47fa-bd36-b2cfe7ae2cde'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] Created reservations ['0af57f65-7340-4a1b-8c9a-217ee2e38f11', '8dce1895-9d15-4d0c-9c5f-fef3aa0b2b4d', 'ba7094f2-8d64-4630-ac60-5972c4913889', '3d73ebdd-ea58-44ed-96c7-63e32292f4de'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:28 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:19:28 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:28 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:19:28 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:29 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd39896a-1c3d-46da-a091-eebbfcbd660e -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504" returned: 0 in 1.071s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:29 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504 is being set with open permissions: ugo+rw Jun 02 16:19:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:29 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504 Jun 02 16:19:29 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:29 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.880s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:29 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:19:29 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] Deleted volume successfully. Jun 02 16:19:29 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:29 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d2a2791c-3465-4646-b94e-779d82b87d1c tempest-VolumesListAdminTestJSON-548541341 None] Lock "cinder-15ff8157-9b78-4183-a071-f8239854479a-delete_volume" released by "delete_volume" :: held 3.427s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.908s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:29 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:19:29 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] Deleted volume successfully. Jun 02 16:19:29 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cac9985a-549b-41d4-84ac-1dc5f04a5471 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "cinder-2545e3b9-8d8a-4f77-9188-1144e8497d78-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:29 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] Acquiring lock "cinder-8c288853-1b6d-440c-b22c-93e4e6f83eba-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:29 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] Lock "cinder-8c288853-1b6d-440c-b22c-93e4e6f83eba-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:29 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:29 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] Acquiring lock "cinder-quobyte-8c288853-1b6d-440c-b22c-93e4e6f83eba" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504" returned: 0 in 0.757s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:29 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] Lock "cinder-quobyte-8c288853-1b6d-440c-b22c-93e4e6f83eba" acquired by "delete_volume" :: waited 0.038s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:30 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5961fba0-7cb6-4bba-8282-8d608dc77826]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8c288853-1b6d-440c-b22c-93e4e6f83eba {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:30 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.info Jun 02 16:19:30 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:30 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8c288853-1b6d-440c-b22c-93e4e6f83eba Jun 02 16:19:30 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:30 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.info" returned: 0 in 0.794s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:30 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.info is being set with open permissions: ugo+rw Jun 02 16:19:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:30 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.info Jun 02 16:19:30 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:31 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8c288853-1b6d-440c-b22c-93e4e6f83eba" returned: 0 in 1.083s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8c288853-1b6d-440c-b22c-93e4e6f83eba {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:31 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8c288853-1b6d-440c-b22c-93e4e6f83eba Jun 02 16:19:31 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:31 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.info" returned: 0 in 0.755s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Acquiring lock "cinder-quobyte-5fb6cb67-aeaf-48c8-997a-b5008135b906" by "_copy_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Lock "cinder-quobyte-5fb6cb67-aeaf-48c8-997a-b5008135b906" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] snapshot: 44a7b82d-7b15-4da2-972d-b0b837ff4504, volume: 5fb6cb67-aeaf-48c8-997a-b5008135b906, {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 16:19:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:31 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[230f4ff8-83cd-4bf8-84ec-648ca70a6103]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:31 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504 Jun 02 16:19:31 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:31 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8c288853-1b6d-440c-b22c-93e4e6f83eba" returned: 0 in 0.754s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] Lock "cinder-quobyte-8c288853-1b6d-440c-b22c-93e4e6f83eba" released by "delete_volume" :: held 1.912s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:31 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] Created reservations ['1388f147-e799-4050-8cc6-6df2f987300e', '27b5dc9d-dbd6-4010-abce-1c053f880102', '13caeb62-9cf0-4c02-868c-2438fbf03745', '89398851-3e24-42a4-91ef-69cf1730de81'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:32 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:19:32 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] Acquiring lock "cinder-d1208003-4bcb-4067-84d9-9253c0873c7b-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "cinder-d1208003-4bcb-4067-84d9-9253c0873c7b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] Acquiring lock "cinder-quobyte-d1208003-4bcb-4067-84d9-9253c0873c7b" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "cinder-quobyte-d1208003-4bcb-4067-84d9-9253c0873c7b" acquired by "delete_volume" :: waited 0.023s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f150ac-f735-495a-a83a-5f050a46a02c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d1208003-4bcb-4067-84d9-9253c0873c7b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:32 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d1208003-4bcb-4067-84d9-9253c0873c7b Jun 02 16:19:32 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:32 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504" returned: 0 in 1.105s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd39896a-1c3d-46da-a091-eebbfcbd660e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Creating direct copy from snapshot {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[448bfc82-a05f-4c49-8ca2-3be63b9015b0]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:32 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.796s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:19:32 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] Deleted volume successfully. Jun 02 16:19:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f183cc03-042d-40bc-9ade-b4ab80e2171b tempest-VolumesListAdminTestJSON-1102822967 None] Lock "cinder-8c288853-1b6d-440c-b22c-93e4e6f83eba-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:32 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e Jun 02 16:19:32 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Flow 'volume_create_manager' (5c23e95d-45c6-47e3-9c28-c9a5cc1ff6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f00e860-8acb-4099-af4e-0d6ec4eb4377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f00e860-8acb-4099-af4e-0d6ec4eb4377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-70564171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82c4f3957a14fa5a586421be16943e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:19:33Z,use_quota=True,user_id='6c419e8ebe8b45f486bbb0940f6d5ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1fc6846-3b8c-430f-8aef-900719823487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1fc6846-3b8c-430f-8aef-900719823487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fbe211-7bbb-4f60-8562-5f3901de045f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG cinder.image.glance [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Creating Keystone auth plugin from conf {{(pid=86488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 16:19:33 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d1208003-4bcb-4067-84d9-9253c0873c7b" returned: 0 in 1.069s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d1208003-4bcb-4067-84d9-9253c0873c7b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:33 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d1208003-4bcb-4067-84d9-9253c0873c7b Jun 02 16:19:33 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:33 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e" returned: 0 in 0.908s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG cinder.utils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Path /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fb6cb67-aeaf-48c8-997a-b5008135b906 not found in is_blk_device check {{(pid=86488) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fb6cb67-aeaf-48c8-997a-b5008135b906 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:33 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fb6cb67-aeaf-48c8-997a-b5008135b906 Jun 02 16:19:33 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fbe211-7bbb-4f60-8562-5f3901de045f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9', 'volume_name': 'volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9', 'volume_size': 1, 'image_id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '802a1494b5514d5c94e7154c7dda716e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'created_at': datetime.datetime(2026, 6, 2, 14, 3, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 3, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb15a1ea-45e0-439f-b10b-b37fe1ef8f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb15a1ea-45e0-439f-b10b-b37fe1ef8f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28eb3f1-94e9-4f2b-85bd-6811f19465f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:33 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Volume 6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9', 'volume_size': 1, 'image_id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '802a1494b5514d5c94e7154c7dda716e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'created_at': datetime.datetime(2026, 6, 2, 14, 3, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 3, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 02 16:19:33 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Trying to clone 6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 from image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}]). {{(pid=86488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 02 16:19:34 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_a257pf_kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 16:19:34 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Image download 20.69 MB at 20.69 MB/s Jun 02 16:19:34 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60291d9-d734-4ef5-a895-d9161e227a3f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_a257pf_kdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:34 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d1208003-4bcb-4067-84d9-9253c0873c7b" returned: 0 in 0.740s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "cinder-quobyte-d1208003-4bcb-4067-84d9-9253c0873c7b" released by "delete_volume" :: held 1.876s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:34 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] Created reservations ['0f221b9e-94f2-4f31-8bf8-80fa21ca9a61', '6f2c1efc-e288-4513-9f8a-e7e60b75e1a8', '47048d92-f5ed-4d46-919e-8f523d1bc502', '68f12927-7f8f-416d-9eef-d86e118262c8'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:19:34 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_a257pf_kdevstack@QuobyteHD Jun 02 16:19:34 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:34 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:19:34 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:35 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_a257pf_kdevstack@QuobyteHD" returned: 0 in 1.354s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:35 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Temporary image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 is fetched for user 6c419e8ebe8b45f486bbb0940f6d5ff4. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 16:19:35 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.284s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:35 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:19:35 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] Deleted volume successfully. Jun 02 16:19:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d0bec3c3-1110-477c-9096-f663bb4730e5 tempest-VolumesListAdminTestJSON-1102822967 None] Lock "cinder-d1208003-4bcb-4067-84d9-9253c0873c7b-delete_volume" released by "delete_volume" :: held 3.502s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:35 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d9b387-1339-442d-b18f-6a0dfb29e8f0]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_a257pf_kdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:36 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_a257pf_kdevstack@QuobyteHD Jun 02 16:19:36 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:36 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:19:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Flow 'volume_create_manager' (5f3f7f76-b9d8-4260-857e-d062a7dece4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c337d8b-176a-445d-a530-2ce2396d1a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c337d8b-176a-445d-a530-2ce2396d1a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-106307146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c2f228-db38-41fc-a9dd-6655fa5893cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c3347577344d8aae5eb4e16367a65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:19:37Z,use_quota=True,user_id='ea36cb0ca48e4166bd0b05f24d992dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f317e7c-fa69-4096-a0ea-8c275f9e5e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f317e7c-fa69-4096-a0ea-8c275f9e5e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:37 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76c59cb-e0cd-48b5-ac0b-75eb6d859236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76c59cb-e0cd-48b5-ac0b-75eb6d859236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c2f228-db38-41fc-a9dd-6655fa5893cb', 'volume_name': 'volume-a6c2f228-db38-41fc-a9dd-6655fa5893cb', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e2a972e-0211-42e1-9ec1-cd0ba94daaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e2a972e-0211-42e1-9ec1-cd0ba94daaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703507a4-cee5-41be-bc7a-ec969b090625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:37 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Volume a6c2f228-db38-41fc-a9dd-6655fa5893cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c2f228-db38-41fc-a9dd-6655fa5893cb', 'volume_size': 1} Jun 02 16:19:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_a257pf_kdevstack@QuobyteHD" returned: 0 in 1.220s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:39 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fb6cb67-aeaf-48c8-997a-b5008135b906" returned: 0 in 6.176s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:39 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a43697-12ae-421f-a3f5-b25052772980]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:40 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e Jun 02 16:19:40 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:40 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e" returned: 0 in 0.909s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:40 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Image conversion details: src /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fb6cb67-aeaf-48c8-997a-b5008135b906 {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:19:40 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Converted 1024.00 MB image at 165.79 MB/s Jun 02 16:19:40 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fb6cb67-aeaf-48c8-997a-b5008135b906 is being set with open permissions: ugo+rw Jun 02 16:19:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fb6cb67-aeaf-48c8-997a-b5008135b906 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:40 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fb6cb67-aeaf-48c8-997a-b5008135b906 Jun 02 16:19:40 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:41 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fb6cb67-aeaf-48c8-997a-b5008135b906" returned: 0 in 0.605s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Lock "cinder-quobyte-5fb6cb67-aeaf-48c8-997a-b5008135b906" released by "_copy_volume_from_snapshot" :: held 9.802s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Acquiring lock "cinder-quobyte-44a7b82d-7b15-4da2-972d-b0b837ff4504" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Lock "cinder-quobyte-44a7b82d-7b15-4da2-972d-b0b837ff4504" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Deleting offline snapshot 44a7b82d-7b15-4da2-972d-b0b837ff4504 of volume cd39896a-1c3d-46da-a091-eebbfcbd660e {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] snapshot_file for this snap is: volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[138a4113-4ce9-41bb-a96f-b7b63d1298fa]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:41 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504 Jun 02 16:19:41 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Flow 'volume_create_manager' (b2d21f91-21c9-46f3-a0da-047a6a6027a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b518f1b0-a032-42a2-838a-353f7cac5f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b518f1b0-a032-42a2-838a-353f7cac5f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-112763959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d181e94-db6e-4a46-96d1-7acd9eef0cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='608331463c4144ee8e133a17a94f7a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:19:42Z,use_quota=True,user_id='8e259cd72fcb4f0298de76b3e3b80d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6187ff5-c316-4243-bad8-36178ae926c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6187ff5-c316-4243-bad8-36178ae926c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0462566-eb73-46d1-98c0-b9a532e23fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0462566-eb73-46d1-98c0-b9a532e23fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d181e94-db6e-4a46-96d1-7acd9eef0cf2', 'volume_name': 'volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ab525c-f9bd-4faa-a57f-13d9ecbd5623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ab525c-f9bd-4faa-a57f-13d9ecbd5623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d2d3f5-aaa9-4087-9a2b-94593b76ae53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:41 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Volume 9d181e94-db6e-4a46-96d1-7acd9eef0cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2', 'volume_size': 1} Jun 02 16:19:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:42 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504" returned: 0 in 0.696s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd39896a-1c3d-46da-a091-eebbfcbd660e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:19:42 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e10fc6a-e617-4250-b638-672ae3f7c153]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:42 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e Jun 02 16:19:42 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:42 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e" returned: 0 in 0.724s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:42 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504 Jun 02 16:19:42 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:43 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504" returned: 0 in 0.675s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:43 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504 Jun 02 16:19:43 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:44 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e.44a7b82d-7b15-4da2-972d-b0b837ff4504" returned: 0 in 0.593s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Lock "cinder-quobyte-44a7b82d-7b15-4da2-972d-b0b837ff4504" released by "_delete_snapshot" :: held 2.774s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.535s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.074s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-106307146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c2f228-db38-41fc-a9dd-6655fa5893cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c3347577344d8aae5eb4e16367a65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:19:37Z,use_quota=True,user_id='ea36cb0ca48e4166bd0b05f24d992dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Creating volume a6c2f228-db38-41fc-a9dd-6655fa5893cb {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:19:44 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a6c2f228-db38-41fc-a9dd-6655fa5893cb 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcbfa3b3-ccb3-4891-9461-18f80b5b23c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fb6cb67-aeaf-48c8-997a-b5008135b906', 'volume_size': 2, 'source_volid': 'cd39896a-1c3d-46da-a091-eebbfcbd660e', 'source_volstatus': 'available'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:44 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a6c2f228-db38-41fc-a9dd-6655fa5893cb 1073741824 Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ddd98d-b708-405a-ab9f-fd0d4f2e08bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:44 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:44 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Volume volume-5fb6cb67-aeaf-48c8-997a-b5008135b906 (5fb6cb67-aeaf-48c8-997a-b5008135b906): created successfully Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ddd98d-b708-405a-ab9f-fd0d4f2e08bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Flow 'volume_create_manager' (0aa4bfc8-0a43-4114-b0ee-9d8869945ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:44 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-e6aef620-787c-4fab-8ad4-3c333faf7f6a tempest-VolumesCloneTest-212475240 None] Created volume successfully. Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] Acquiring lock "cinder-5fb6cb67-aeaf-48c8-997a-b5008135b906-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] Lock "cinder-5fb6cb67-aeaf-48c8-997a-b5008135b906-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] Acquiring lock "cinder-quobyte-5fb6cb67-aeaf-48c8-997a-b5008135b906" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] Lock "cinder-quobyte-5fb6cb67-aeaf-48c8-997a-b5008135b906" acquired by "delete_volume" :: waited 0.024s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd9d8b8-20c3-4e33-91ea-0b9c7aa0d7a1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fb6cb67-aeaf-48c8-997a-b5008135b906 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:44 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fb6cb67-aeaf-48c8-997a-b5008135b906 Jun 02 16:19:44 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:45 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a6c2f228-db38-41fc-a9dd-6655fa5893cb 1073741824" returned: 0 in 0.838s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a6c2f228-db38-41fc-a9dd-6655fa5893cb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:45 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a6c2f228-db38-41fc-a9dd-6655fa5893cb Jun 02 16:19:45 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:45 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fb6cb67-aeaf-48c8-997a-b5008135b906" returned: 0 in 0.821s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fb6cb67-aeaf-48c8-997a-b5008135b906 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:45 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fb6cb67-aeaf-48c8-997a-b5008135b906 Jun 02 16:19:45 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:45 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a6c2f228-db38-41fc-a9dd-6655fa5893cb" returned: 0 in 0.604s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.564s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-70564171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82c4f3957a14fa5a586421be16943e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:19:33Z,use_quota=True,user_id='6c419e8ebe8b45f486bbb0940f6d5ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Creating volume 6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:19:45 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:45 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 1073741824 Jun 02 16:19:45 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703507a4-cee5-41be-bc7a-ec969b090625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c2f228-db38-41fc-a9dd-6655fa5893cb', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0133a8b8-98ba-4dec-ac78-e88ae23c9c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:45 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Volume volume-a6c2f228-db38-41fc-a9dd-6655fa5893cb (a6c2f228-db38-41fc-a9dd-6655fa5893cb): created successfully Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0133a8b8-98ba-4dec-ac78-e88ae23c9c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Flow 'volume_create_manager' (5f3f7f76-b9d8-4260-857e-d062a7dece4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:45 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-7c673cd9-b101-4248-949e-29275262b451 tempest-VolumesServicesTestJSON-1849509005 None] Created volume successfully. Jun 02 16:19:46 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fb6cb67-aeaf-48c8-997a-b5008135b906" returned: 0 in 0.662s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] Lock "cinder-quobyte-5fb6cb67-aeaf-48c8-997a-b5008135b906" released by "delete_volume" :: held 1.530s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:46 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] Created reservations ['6c381533-533c-4940-a047-7514912b35da', '95b17f20-0443-4e41-8dc4-f8df49a28d1c', '94bad0ca-ecc5-44ce-826c-31a37eda2836', 'ac959fcb-4ca9-4025-8563-b5855890a00b'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:19:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:46 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:19:46 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:46 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 1073741824" returned: 0 in 0.821s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] Acquiring lock "cinder-a6c2f228-db38-41fc-a9dd-6655fa5893cb-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] Lock "cinder-a6c2f228-db38-41fc-a9dd-6655fa5893cb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:46 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 Jun 02 16:19:46 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] Acquiring lock "cinder-quobyte-a6c2f228-db38-41fc-a9dd-6655fa5893cb" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] Lock "cinder-quobyte-a6c2f228-db38-41fc-a9dd-6655fa5893cb" acquired by "delete_volume" :: waited 0.021s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:46 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[65725da0-9861-4908-ae32-49adbfab597d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a6c2f228-db38-41fc-a9dd-6655fa5893cb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:46 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a6c2f228-db38-41fc-a9dd-6655fa5893cb Jun 02 16:19:46 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] Acquiring lock "cinder-cd39896a-1c3d-46da-a091-eebbfcbd660e-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] Lock "cinder-cd39896a-1c3d-46da-a091-eebbfcbd660e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] Acquiring lock "cinder-quobyte-cd39896a-1c3d-46da-a091-eebbfcbd660e" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] Lock "cinder-quobyte-cd39896a-1c3d-46da-a091-eebbfcbd660e" acquired by "delete_volume" :: waited 0.022s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:19:47 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.791s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:19:47 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] Deleted volume successfully. Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88691e2-2d68-4d64-b8ca-d21fa1c13fa5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-80b6c526-b02a-44ad-9d03-a6b0af8ca623 tempest-VolumesCloneTest-212475240 None] Lock "cinder-5fb6cb67-aeaf-48c8-997a-b5008135b906-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:47 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9" returned: 0 in 0.677s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.350s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-112763959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d181e94-db6e-4a46-96d1-7acd9eef0cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='608331463c4144ee8e133a17a94f7a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:19:42Z,use_quota=True,user_id='8e259cd72fcb4f0298de76b3e3b80d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Creating volume 9d181e94-db6e-4a46-96d1-7acd9eef0cf2 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:19:47 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:47 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 1073741824 Jun 02 16:19:47 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Attempting download of d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}])) to volume 6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 16:19:47 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e Jun 02 16:19:47 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[185065a2-a6be-422b-98bb-792dc2d98824]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9__qfrm4g6 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:47 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9__qfrm4g6 Jun 02 16:19:47 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:47 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a6c2f228-db38-41fc-a9dd-6655fa5893cb" returned: 0 in 0.836s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a6c2f228-db38-41fc-a9dd-6655fa5893cb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:47 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a6c2f228-db38-41fc-a9dd-6655fa5893cb Jun 02 16:19:47 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:48 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e" returned: 0 in 0.903s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:48 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e Jun 02 16:19:48 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:48 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9__qfrm4g6" returned: 0 in 0.884s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9__qfrm4g6 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:48 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:48 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 1073741824" returned: 0 in 1.079s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a6c2f228-db38-41fc-a9dd-6655fa5893cb" returned: 0 in 0.771s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] Lock "cinder-quobyte-a6c2f228-db38-41fc-a9dd-6655fa5893cb" released by "delete_volume" :: held 1.665s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:48 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9__qfrm4g6 Jun 02 16:19:48 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=91,cinder:UPDATE=122,cinder:INSERT=24,cinder:DELETE=9 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:48 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 Jun 02 16:19:48 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] Created reservations ['65f5408b-2bc7-42b3-ba82-24f1479bb862', '81968351-33ba-4d97-b5d3-03d8aadfec41', '8b874966-79b5-454d-8b1d-3c85b6ea2786', 'af52d90a-9513-4713-8091-5fb5e1559d91'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:48 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:19:48 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:48 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cd39896a-1c3d-46da-a091-eebbfcbd660e" returned: 0 in 0.767s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] Lock "cinder-quobyte-cd39896a-1c3d-46da-a091-eebbfcbd660e" released by "delete_volume" :: held 1.764s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:48 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=85,cinder:UPDATE=118,cinder:INSERT=36,cinder:DELETE=11 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] Created reservations ['f0a377be-8447-4d59-802e-8ea6a60b087d', '6a0e2bc1-abad-4cdd-9c81-b9b0caa1e89e', '86085d97-20d5-426a-8603-ea1da1aab52a', 'ca15e605-f774-405e-b3c6-3ab4c525bbb8'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:49 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:19:49 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:49 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:49 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2" returned: 0 in 0.803s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9__qfrm4g6" returned: 1 in 0.977s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9__qfrm4g6' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0794649-663f-4bfd-8243-36782e90ef58]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_a257pf_kdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d2d3f5-aaa9-4087-9a2b-94593b76ae53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fe4f96-d9dd-4c30-8388-0122c6f349f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:49 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Volume volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 (9d181e94-db6e-4a46-96d1-7acd9eef0cf2): created successfully Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fe4f96-d9dd-4c30-8388-0122c6f349f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Flow 'volume_create_manager' (b2d21f91-21c9-46f3-a0da-047a6a6027a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:49 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.746s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:19:49 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] Deleted volume successfully. Jun 02 16:19:49 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-557e5ed9-923a-4271-ab23-c500d3b7b4fd tempest-VolumesDeleteCascade-883593678 None] Created volume successfully. Jun 02 16:19:49 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-68873e38-24ae-4ac5-b0d1-04849c0b7236 tempest-VolumesServicesTestJSON-1849509005 None] Lock "cinder-a6c2f228-db38-41fc-a9dd-6655fa5893cb-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:49 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_a257pf_kdevstack@QuobyteHD Jun 02 16:19:49 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:50 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.794s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:50 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:19:50 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] Deleted volume successfully. Jun 02 16:19:50 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-138dbb88-1b51-468b-847d-54e7cad2a67e tempest-VolumesCloneTest-212475240 None] Lock "cinder-cd39896a-1c3d-46da-a091-eebbfcbd660e-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:19:50 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_a257pf_kdevstack@QuobyteHD" returned: 0 in 0.950s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:50 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 was qcow2, converting to raw {{(pid=86488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 16:19:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_a257pf_kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:50 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_a257pf_kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 Jun 02 16:19:50 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] Creating offline snapshot 05a5ef46-3b23-4850-832e-6017b90308d9 of volume 9d181e94-db6e-4a46-96d1-7acd9eef0cf2 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:19:50 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b96f3b8-da61-4ad4-a218-e346119909ee]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:51 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 Jun 02 16:19:51 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:51 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2" returned: 0 in 0.914s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:51 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 1G Jun 02 16:19:51 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:52 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_a257pf_kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9" returned: 0 in 2.443s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:52 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_a257pf_kdevstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:19:52 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Converted 112.00 MB image at 45.81 MB/s Jun 02 16:19:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:52 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 1G Jun 02 16:19:52 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:52 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 1G" returned: 0 in 0.937s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:52 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 Jun 02 16:19:52 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:53 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 1G" returned: 0 in 0.759s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:53 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:53 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c465809-5032-407b-98e7-3b9cf3f60d2b]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9" returned: 0 in 0.797s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:53 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 is being set with open permissions: ugo+rw Jun 02 16:19:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:53 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 Jun 02 16:19:53 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:53 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 Jun 02 16:19:53 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:54 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9" returned: 0 in 0.754s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:54 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.info Jun 02 16:19:54 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:54 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9" returned: 0 in 1.023s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:54 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 Jun 02 16:19:54 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:55 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.info" returned: 0 in 0.734s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:55 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.info is being set with open permissions: ugo+rw Jun 02 16:19:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:55 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.info Jun 02 16:19:55 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:55 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9" returned: 1 in 0.988s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:19:55 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Downloaded image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}])) to volume 6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 successfully. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 16:19:55 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Temporary image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 for user 6c419e8ebe8b45f486bbb0940f6d5ff4 is deleted. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 16:19:55 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Marking volume 6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 as bootable. {{(pid=86488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 16:19:55 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Copying metadata from image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 to 6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9. {{(pid=86488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 16:19:55 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Creating volume glance metadata for volume 6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 backed by image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 16:19:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28eb3f1-94e9-4f2b-85bd-6811f19465f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9', 'volume_size': 1, 'image_id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '802a1494b5514d5c94e7154c7dda716e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'created_at': datetime.datetime(2026, 6, 2, 14, 3, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 3, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed93622-dec0-4754-8885-1d69ccaec4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:19:55 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Volume volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 (6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9): created successfully Jun 02 16:19:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed93622-dec0-4754-8885-1d69ccaec4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:19:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Flow 'volume_create_manager' (5c23e95d-45c6-47e3-9c28-c9a5cc1ff6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:19:55 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0901e539-72c5-49fc-a4d7-bbfe9bdccc96 tempest-VolumesExtendTest-481625465 None] Created volume successfully. Jun 02 16:19:55 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.info" returned: 0 in 0.673s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.955s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:55 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0b7c611a-4daa-4c78-81a2-cd22569dadb3 tempest-VolumesDeleteCascade-883593678 None] Create snapshot completed successfully Jun 02 16:19:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-68ae6390-6a81-42a6-ba07-0537635165e0 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-68ae6390-6a81-42a6-ba07-0537635165e0 tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:56 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-68ae6390-6a81-42a6-ba07-0537635165e0 tempest-VolumesDeleteCascade-883593678 None] Creating offline snapshot fdebdc12-e86c-4f6c-b33b-27012c70447d of volume 9d181e94-db6e-4a46-96d1-7acd9eef0cf2 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:19:56 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[92def0ba-e2d7-444f-a2e3-ef0d1be07256]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-68ae6390-6a81-42a6-ba07-0537635165e0 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:56 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 Jun 02 16:19:56 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-38ccc17e-998a-4de4-9d65-38cbe2939d7e tempest-VolumesExtendTest-481625465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:19:57 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-68ae6390-6a81-42a6-ba07-0537635165e0 tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9" returned: 0 in 0.906s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-68ae6390-6a81-42a6-ba07-0537635165e0 tempest-VolumesDeleteCascade-883593678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:19:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-68ae6390-6a81-42a6-ba07-0537635165e0 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:57 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d 1G Jun 02 16:19:57 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:58 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-68ae6390-6a81-42a6-ba07-0537635165e0 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d 1G" returned: 0 in 0.921s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-68ae6390-6a81-42a6-ba07-0537635165e0 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:58 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d Jun 02 16:19:58 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:59 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-68ae6390-6a81-42a6-ba07-0537635165e0 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d" returned: 0 in 0.740s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:59 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-68ae6390-6a81-42a6-ba07-0537635165e0 tempest-VolumesDeleteCascade-883593678 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d is being set with open permissions: ugo+rw Jun 02 16:19:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-68ae6390-6a81-42a6-ba07-0537635165e0 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:59 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d Jun 02 16:19:59 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:19:59 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Jun 02 16:19:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-68ae6390-6a81-42a6-ba07-0537635165e0 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d" returned: 0 in 0.661s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:19:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-68ae6390-6a81-42a6-ba07-0537635165e0 tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.421s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:19:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-38ccc17e-998a-4de4-9d65-38cbe2939d7e tempest-VolumesExtendTest-481625465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.971s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:19:59 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-68ae6390-6a81-42a6-ba07-0537635165e0 tempest-VolumesDeleteCascade-883593678 None] Create snapshot completed successfully Jun 02 16:19:59 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[022427da-ebf4-41c4-b23c-56a660ffe351]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:19:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-38ccc17e-998a-4de4-9d65-38cbe2939d7e tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:19:59 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 Jun 02 16:19:59 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:00 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:20:00 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "cinder-9d181e94-db6e-4a46-96d1-7acd9eef0cf2-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-9d181e94-db6e-4a46-96d1-7acd9eef0cf2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Performing cascade delete. {{(pid=86488) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "cinder-05a5ef46-3b23-4850-832e-6017b90308d9-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-05a5ef46-3b23-4850-832e-6017b90308d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "cinder-quobyte-9d181e94-db6e-4a46-96d1-7acd9eef0cf2" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:00 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-38ccc17e-998a-4de4-9d65-38cbe2939d7e tempest-VolumesExtendTest-481625465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9" returned: 0 in 1.030s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-38ccc17e-998a-4de4-9d65-38cbe2939d7e tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-9d181e94-db6e-4a46-96d1-7acd9eef0cf2" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "cinder-quobyte-05a5ef46-3b23-4850-832e-6017b90308d9" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-05a5ef46-3b23-4850-832e-6017b90308d9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Deleting offline snapshot 05a5ef46-3b23-4850-832e-6017b90308d9 of volume 9d181e94-db6e-4a46-96d1-7acd9eef0cf2 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] snapshot_file for this snap is: volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[01960294-8b71-4fa3-a801-484a6457934b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:00 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 Jun 02 16:20:00 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:01 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.932s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:01 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:20:01 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 Jun 02 16:20:01 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:01 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-38ccc17e-998a-4de4-9d65-38cbe2939d7e tempest-VolumesExtendTest-481625465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9" returned: 1 in 0.939s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-38ccc17e-998a-4de4-9d65-38cbe2939d7e tempest-VolumesExtendTest-481625465 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:20:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-38ccc17e-998a-4de4-9d65-38cbe2939d7e tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 2G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-38ccc17e-998a-4de4-9d65-38cbe2939d7e tempest-VolumesExtendTest-481625465 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 2G" returned: 0 in 0.130s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-38ccc17e-998a-4de4-9d65-38cbe2939d7e tempest-VolumesExtendTest-481625465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.162s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:02 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-38ccc17e-998a-4de4-9d65-38cbe2939d7e tempest-VolumesExtendTest-481625465 None] Extend volume completed successfully. Jun 02 16:20:02 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9" returned: 0 in 1.063s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:20:02 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39a8d0a-f307-4850-a0dc-172468df3056]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:02 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 Jun 02 16:20:02 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:02 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Acquiring lock "cinder-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:02 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Lock "cinder-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:02 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Acquiring lock "cinder-quobyte-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:02 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Lock "cinder-quobyte-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9" acquired by "delete_volume" :: waited 0.015s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:02 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[81958eb8-83b3-4f1b-8162-b55d7b483c8a]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:03 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 Jun 02 16:20:03 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:03 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2" returned: 0 in 1.012s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:03 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf999d1f-cb02-4674-b5d7-b5a69ea6d01f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:03 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d Jun 02 16:20:03 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:03 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9" returned: 0 in 1.103s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:04 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 Jun 02 16:20:04 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:04 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d" returned: 0 in 1.029s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:20:04 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[baac328c-8f1b-446f-9074-8f3e29046e59]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:04 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 Jun 02 16:20:04 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:04 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9" returned: 1 in 1.059s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:20:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:05 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9 Jun 02 16:20:05 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:05 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9" returned: 0 in 1.078s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:05 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:20:05 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[67218467-af06-4004-adf7-5f0560abb435]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:05 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 Jun 02 16:20:05 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:05 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9" returned: 0 in 0.789s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Lock "cinder-quobyte-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9" released by "delete_volume" :: held 3.058s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:05 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Created reservations ['467a53ce-0b6a-433e-814c-9c015d800bf3', '96ce3c12-fd49-49b0-847a-e7ba9db15cc0', '1a5cd782-6b71-4eab-94d2-3ef45860d4fe', '08aa72a2-cdd4-4cb0-bf49-861dcc088508'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:06 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:20:06 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:06 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2" returned: 0 in 1.090s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:06 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 Jun 02 16:20:06 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Flow 'volume_create_manager' (405eb8bc-bed5-49a8-9161-e7fdb6b35f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e17c48-a4e7-42cf-9949-8b407d1d8a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e17c48-a4e7-42cf-9949-8b407d1d8a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-506126123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e5b614-e492-495a-90ee-199ccedb44c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82c4f3957a14fa5a586421be16943e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:20:07Z,use_quota=True,user_id='6c419e8ebe8b45f486bbb0940f6d5ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ece7910-b294-4452-a6f6-03ee6fc32d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ece7910-b294-4452-a6f6-03ee6fc32d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe0a5aa-2f2f-498f-adff-7ffadb7d77aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe0a5aa-2f2f-498f-adff-7ffadb7d77aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e5b614-e492-495a-90ee-199ccedb44c8', 'volume_name': 'volume-56e5b614-e492-495a-90ee-199ccedb44c8', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7035d5-fe4d-4ecb-8501-eb6eb0fafc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7035d5-fe4d-4ecb-8501-eb6eb0fafc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be09e51d-a0bf-4dd5-b730-2c0f28981ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:06 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Volume 56e5b614-e492-495a-90ee-199ccedb44c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e5b614-e492-495a-90ee-199ccedb44c8', 'volume_size': 1} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-506126123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e5b614-e492-495a-90ee-199ccedb44c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82c4f3957a14fa5a586421be16943e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:20:07Z,use_quota=True,user_id='6c419e8ebe8b45f486bbb0940f6d5ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Creating volume 56e5b614-e492-495a-90ee-199ccedb44c8 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:20:06 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:20:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:06 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8 1073741824 Jun 02 16:20:06 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:07 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.999s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:07 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:20:07 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Deleted volume successfully. Jun 02 16:20:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-14106570-b995-47b7-82d2-af9a5eb78bec tempest-VolumesExtendTest-481625465 None] Lock "cinder-6b140f7c-e0ce-44e1-a7bd-ac5b5e437aa9-delete_volume" released by "delete_volume" :: held 4.453s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:07 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9" returned: 0 in 1.078s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:07 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9 Jun 02 16:20:07 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:07 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8 1073741824" returned: 0 in 1.131s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:08 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8 Jun 02 16:20:08 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:08 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.05a5ef46-3b23-4850-832e-6017b90308d9" returned: 0 in 0.852s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d -F qcow2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:08 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d -F qcow2 Jun 02 16:20:08 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:08 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8" returned: 0 in 0.803s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:20:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.997s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be09e51d-a0bf-4dd5-b730-2c0f28981ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e5b614-e492-495a-90ee-199ccedb44c8', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df61a3e-fe85-49b0-8c61-a3d8ca0fe144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:08 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Volume volume-56e5b614-e492-495a-90ee-199ccedb44c8 (56e5b614-e492-495a-90ee-199ccedb44c8): created successfully Jun 02 16:20:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df61a3e-fe85-49b0-8c61-a3d8ca0fe144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Flow 'volume_create_manager' (405eb8bc-bed5-49a8-9161-e7fdb6b35f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:20:08 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-4cf59871-57a9-48f3-bdc9-cb627654794b tempest-VolumesExtendTest-481625465 None] Created volume successfully. Jun 02 16:20:09 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d -F qcow2" returned: 0 in 0.884s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-05a5ef46-3b23-4850-832e-6017b90308d9" released by "_delete_snapshot" :: held 8.362s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-9d181e94-db6e-4a46-96d1-7acd9eef0cf2" released by "delete_snapshot" :: held 8.399s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:09 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Created reservations ['432f3f18-0d63-4442-9497-4e32e6087216', 'ed52b33f-172c-4fdc-b047-3b65d820ab28', '366563b8-ba72-43dd-ac8d-9f4bfee1001b', '3f47c41d-18b8-43a3-8eb5-deb14bc7cd3f'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:20:09 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Delete snapshot completed successfully. Jun 02 16:20:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-05a5ef46-3b23-4850-832e-6017b90308d9-delete_snapshot" released by "delete_snapshot" :: held 8.631s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "cinder-fdebdc12-e86c-4f6c-b33b-27012c70447d-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-fdebdc12-e86c-4f6c-b33b-27012c70447d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "cinder-quobyte-9d181e94-db6e-4a46-96d1-7acd9eef0cf2" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-9d181e94-db6e-4a46-96d1-7acd9eef0cf2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "cinder-quobyte-fdebdc12-e86c-4f6c-b33b-27012c70447d" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-fdebdc12-e86c-4f6c-b33b-27012c70447d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Deleting offline snapshot fdebdc12-e86c-4f6c-b33b-27012c70447d of volume 9d181e94-db6e-4a46-96d1-7acd9eef0cf2 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:20:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] snapshot_file for this snap is: volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:20:09 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[754d3105-8525-4943-a742-5a14fae23d03]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:09 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d Jun 02 16:20:09 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] Creating offline snapshot d6da468f-0384-4fc5-a4d0-aca6ee69656a of volume 56e5b614-e492-495a-90ee-199ccedb44c8 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:20:10 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d" returned: 0 in 0.866s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:20:10 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[144d25fe-3ede-46b1-a186-b839d65662da]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:10 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[791a7826-a4f7-4502-a0dd-839c3d870746]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:10 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8 Jun 02 16:20:10 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:10 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 Jun 02 16:20:10 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:11 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8" returned: 0 in 0.974s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:11 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a 1G Jun 02 16:20:11 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:11 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2" returned: 0 in 1.140s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:11 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d Jun 02 16:20:11 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:12 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a 1G" returned: 0 in 1.035s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e5b614-e492-495a-90ee-199ccedb44c8 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:12 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e5b614-e492-495a-90ee-199ccedb44c8 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a Jun 02 16:20:12 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:12 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d" returned: 0 in 0.958s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:12 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d Jun 02 16:20:12 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:13 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e5b614-e492-495a-90ee-199ccedb44c8 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a" returned: 0 in 0.740s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:13 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a is being set with open permissions: ugo+rw Jun 02 16:20:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:13 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a Jun 02 16:20:13 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:13 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2.fdebdc12-e86c-4f6c-b33b-27012c70447d" returned: 0 in 0.752s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-fdebdc12-e86c-4f6c-b33b-27012c70447d" released by "_delete_snapshot" :: held 3.867s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-9d181e94-db6e-4a46-96d1-7acd9eef0cf2" released by "delete_snapshot" :: held 3.893s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:13 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Created reservations ['2f01ed22-80e2-40eb-bd12-f2a97ae93702', 'ae37e4ca-a2b0-4cd5-a31c-83d205146a1e', '3e84e787-06bc-409d-8e48-040c636cae6e', '5c531cf0-573b-4048-9cef-88b64bac16e2'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:20:13 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Delete snapshot completed successfully. Jun 02 16:20:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-fdebdc12-e86c-4f6c-b33b-27012c70447d-delete_snapshot" released by "delete_snapshot" :: held 4.108s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:13 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Snapshots deleted, issuing volume delete {{(pid=86488) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 02 16:20:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "cinder-quobyte-9d181e94-db6e-4a46-96d1-7acd9eef0cf2" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-9d181e94-db6e-4a46-96d1-7acd9eef0cf2" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:13 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8be727-53b9-4271-a2ee-b6913088cecd]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:13 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 Jun 02 16:20:13 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:13 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a" returned: 0 in 0.763s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:14 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.info Jun 02 16:20:14 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:14 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2" returned: 0 in 1.077s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:14 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2 Jun 02 16:20:14 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:14 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.info" returned: 0 in 0.901s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:14 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.info is being set with open permissions: ugo+rw Jun 02 16:20:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:15 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.info Jun 02 16:20:15 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:15 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9d181e94-db6e-4a46-96d1-7acd9eef0cf2" returned: 0 in 0.756s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-9d181e94-db6e-4a46-96d1-7acd9eef0cf2" released by "delete_volume" :: held 1.913s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:15 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Created reservations ['c02fbafc-484e-4dd7-a270-3101d182083b', '7586990d-5b87-475f-a0db-1eaa82b63df2', '722dea50-3953-49ac-a69e-0d78b5a6c80a', '7e8ef840-e3ef-4500-a897-597dccfc03e9'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:20:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:15 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:20:15 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:20:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:15 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:15 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:20:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.info" returned: 0 in 0.733s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:15 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.353s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:15 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-c897c77d-b6c2-4c6e-987e-670d9e6a8457 tempest-VolumesExtendTest-481625465 None] Create snapshot completed successfully Jun 02 16:20:16 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.930s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:16 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:20:16 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Deleted volume successfully. Jun 02 16:20:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce9f5d80-f324-4f47-964d-bc14172d8dd4 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-9d181e94-db6e-4a46-96d1-7acd9eef0cf2-delete_volume" released by "delete_volume" :: held 15.966s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-33e1c82c-809d-4a5d-a837-bbc28621fd04 tempest-VolumesExtendTest-481625465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-33e1c82c-809d-4a5d-a837-bbc28621fd04 tempest-VolumesExtendTest-481625465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2b7b30-2497-4a99-b921-3f24cb2eaa3c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-33e1c82c-809d-4a5d-a837-bbc28621fd04 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Flow 'volume_create_manager' (7abcd188-1c08-4388-8708-da31606079ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63e897b-be35-4754-a5fe-3c9e275b7484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63e897b-be35-4754-a5fe-3c9e275b7484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-895888649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a84898d-bcf2-4d63-925f-314675394592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='608331463c4144ee8e133a17a94f7a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:20:17Z,use_quota=True,user_id='8e259cd72fcb4f0298de76b3e3b80d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd6c40f-22dc-47da-9ef0-76fc822df20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd6c40f-22dc-47da-9ef0-76fc822df20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e775b3a3-cbab-4c96-a6a2-a0e82f2e9879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e775b3a3-cbab-4c96-a6a2-a0e82f2e9879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a84898d-bcf2-4d63-925f-314675394592', 'volume_name': 'volume-6a84898d-bcf2-4d63-925f-314675394592', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:17 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8 Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6d8f07-e95f-4b64-a68e-2137f13570ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:17 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6d8f07-e95f-4b64-a68e-2137f13570ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbac91d8-c260-483e-8514-3fadfeb0e632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:17 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Volume 6a84898d-bcf2-4d63-925f-314675394592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a84898d-bcf2-4d63-925f-314675394592', 'volume_size': 1} Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:17 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-33e1c82c-809d-4a5d-a837-bbc28621fd04 tempest-VolumesExtendTest-481625465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8" returned: 0 in 0.807s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-33e1c82c-809d-4a5d-a837-bbc28621fd04 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a 2G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-33e1c82c-809d-4a5d-a837-bbc28621fd04 tempest-VolumesExtendTest-481625465 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a 2G" returned: 0 in 0.221s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-33e1c82c-809d-4a5d-a837-bbc28621fd04 tempest-VolumesExtendTest-481625465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.087s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-895888649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a84898d-bcf2-4d63-925f-314675394592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='608331463c4144ee8e133a17a94f7a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:20:17Z,use_quota=True,user_id='8e259cd72fcb4f0298de76b3e3b80d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:20:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Creating volume 6a84898d-bcf2-4d63-925f-314675394592 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:20:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:20:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:20:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:20:18 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:20:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:18 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 1073741824 Jun 02 16:20:18 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:18 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-33e1c82c-809d-4a5d-a837-bbc28621fd04 tempest-VolumesExtendTest-481625465 None] Extend volume completed successfully. Jun 02 16:20:19 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 1073741824" returned: 0 in 1.242s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] Acquiring lock "cinder-d6da468f-0384-4fc5-a4d0-aca6ee69656a-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] Lock "cinder-d6da468f-0384-4fc5-a4d0-aca6ee69656a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] Acquiring lock "cinder-quobyte-56e5b614-e492-495a-90ee-199ccedb44c8" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] Lock "cinder-quobyte-56e5b614-e492-495a-90ee-199ccedb44c8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] Acquiring lock "cinder-quobyte-d6da468f-0384-4fc5-a4d0-aca6ee69656a" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:19 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 Jun 02 16:20:19 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] Lock "cinder-quobyte-d6da468f-0384-4fc5-a4d0-aca6ee69656a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] Deleting offline snapshot d6da468f-0384-4fc5-a4d0-aca6ee69656a of volume 56e5b614-e492-495a-90ee-199ccedb44c8 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:20:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] snapshot_file for this snap is: volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:20:19 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10b589f-6e53-4c78-b540-c2ca3a123a24]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:19 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a Jun 02 16:20:19 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:20 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592" returned: 0 in 0.927s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] <== create_volume: return (2258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:20:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.263s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbac91d8-c260-483e-8514-3fadfeb0e632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a84898d-bcf2-4d63-925f-314675394592', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d390612-32b3-4a7c-94a3-2b1c0e1b773a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:20 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Volume volume-6a84898d-bcf2-4d63-925f-314675394592 (6a84898d-bcf2-4d63-925f-314675394592): created successfully Jun 02 16:20:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d390612-32b3-4a7c-94a3-2b1c0e1b773a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Flow 'volume_create_manager' (7abcd188-1c08-4388-8708-da31606079ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:20:20 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-58cb16a1-a6df-4bb6-8de9-9ae8eaefd3ef tempest-VolumesDeleteCascade-883593678 None] Created volume successfully. Jun 02 16:20:20 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a" returned: 0 in 1.202s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56e5b614-e492-495a-90ee-199ccedb44c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:20:20 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c7d9f3-fe53-47fb-91e7-b96b4527ce41]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:20 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8 Jun 02 16:20:20 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:21 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8" returned: 0 in 1.017s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:21 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a Jun 02 16:20:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] Creating offline snapshot d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da of volume 6a84898d-bcf2-4d63-925f-314675394592 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:20:21 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:21 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2014200e-36fc-4083-90b6-75ddec1ba2a9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:22 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 Jun 02 16:20:22 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:22 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a" returned: 0 in 0.948s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:22 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592" returned: 0 in 0.913s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:22 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a Jun 02 16:20:22 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:22 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da 1G Jun 02 16:20:22 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:23 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8.d6da468f-0384-4fc5-a4d0-aca6ee69656a" returned: 0 in 0.926s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] Lock "cinder-quobyte-d6da468f-0384-4fc5-a4d0-aca6ee69656a" released by "_delete_snapshot" :: held 4.254s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] Lock "cinder-quobyte-56e5b614-e492-495a-90ee-199ccedb44c8" released by "delete_snapshot" :: held 4.290s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:23 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da 1G" returned: 0 in 1.026s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a84898d-bcf2-4d63-925f-314675394592 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:23 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a84898d-bcf2-4d63-925f-314675394592 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da Jun 02 16:20:23 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:23 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] Created reservations ['f38dbc7d-cc51-42a4-9ab8-e8ad9b5077ab', '2802a8e0-316f-484e-b4d2-69b8a5e90f33', 'b6ae6373-2136-48d1-88b5-f7c69d6d4e63', 'b4dbb8c4-febd-475c-a199-839d2f7dece0'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:20:24 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] Delete snapshot completed successfully. Jun 02 16:20:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-19036baf-c294-4cec-9be9-28e2d25ce740 tempest-VolumesExtendTest-481625465 None] Lock "cinder-d6da468f-0384-4fc5-a4d0-aca6ee69656a-delete_snapshot" released by "delete_snapshot" :: held 4.573s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:24 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a84898d-bcf2-4d63-925f-314675394592 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da" returned: 0 in 0.846s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:24 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da is being set with open permissions: ugo+rw Jun 02 16:20:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:24 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da Jun 02 16:20:24 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] Acquiring lock "cinder-56e5b614-e492-495a-90ee-199ccedb44c8-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] Lock "cinder-56e5b614-e492-495a-90ee-199ccedb44c8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] Acquiring lock "cinder-quobyte-56e5b614-e492-495a-90ee-199ccedb44c8" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] Lock "cinder-quobyte-56e5b614-e492-495a-90ee-199ccedb44c8" acquired by "delete_volume" :: waited 0.024s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:25 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0889d787-0762-45a4-a725-27b83e0e59d3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:25 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8 Jun 02 16:20:25 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:25 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da" returned: 0 in 0.882s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:25 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.info Jun 02 16:20:25 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:26 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8" returned: 0 in 0.954s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:26 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8 Jun 02 16:20:26 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:26 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.info" returned: 0 in 0.794s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:26 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.info is being set with open permissions: ugo+rw Jun 02 16:20:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:26 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.info Jun 02 16:20:26 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:26 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-56e5b614-e492-495a-90ee-199ccedb44c8" returned: 0 in 0.719s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] Lock "cinder-quobyte-56e5b614-e492-495a-90ee-199ccedb44c8" released by "delete_volume" :: held 1.768s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:26 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] Created reservations ['adb7eac5-c870-40e5-8cbe-77fb30f9ca2f', 'ab600581-7f5a-4cbb-ad89-206680840326', '4cb552b5-0c73-4203-9000-d127ab25a3fc', '2e6c5619-fc3a-4fff-bf43-0dda2df2136b'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:20:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:27 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:20:27 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:20:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:27 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:20:27 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:27 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.info" returned: 0 in 0.884s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.493s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:27 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-1d1d8b8a-5e97-4a63-8482-07dcca080d8a tempest-VolumesDeleteCascade-883593678 None] Create snapshot completed successfully Jun 02 16:20:27 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.757s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:27 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:20:27 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] Deleted volume successfully. Jun 02 16:20:27 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fe6cfffa-d101-4419-af55-30d56cb5d97c tempest-VolumesExtendTest-481625465 None] Lock "cinder-56e5b614-e492-495a-90ee-199ccedb44c8-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Flow 'volume_create_manager' (0060a60d-10bf-4dfe-9999-2fbd898d0773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8a8d77-df14-4c5c-a6d6-37315bd553a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8a8d77-df14-4c5c-a6d6-37315bd553a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-481612008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51604fe-b59d-4aee-8698-b1c6c76ae395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='608331463c4144ee8e133a17a94f7a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:20:29Z,use_quota=True,user_id='8e259cd72fcb4f0298de76b3e3b80d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe0a18f-9ca7-4210-8d7c-de2a5b8afd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe0a18f-9ca7-4210-8d7c-de2a5b8afd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f02308-4b0c-48ae-99a6-e76cde17c5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f02308-4b0c-48ae-99a6-e76cde17c5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f51604fe-b59d-4aee-8698-b1c6c76ae395', 'volume_name': 'volume-f51604fe-b59d-4aee-8698-b1c6c76ae395', 'volume_size': 1, 'snapshot_id': 'd95f3e3d-cfd6-4900-bfa2-721cd3e8d7da'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (148f4e2c-d20f-48b7-ad74-3d26e9aef05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (148f4e2c-d20f-48b7-ad74-3d26e9aef05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efd228c-6980-4ec4-a8c2-58702c08a466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:28 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Volume f51604fe-b59d-4aee-8698-b1c6c76ae395: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f51604fe-b59d-4aee-8698-b1c6c76ae395', 'volume_size': 1, 'snapshot_id': 'd95f3e3d-cfd6-4900-bfa2-721cd3e8d7da'} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "cinder-quobyte-d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da-f51604fe-b59d-4aee-8698-b1c6c76ae395" by "_create_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da-f51604fe-b59d-4aee-8698-b1c6c76ae395" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Creating volume f51604fe-b59d-4aee-8698-b1c6c76ae395 from snapshot d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da {{(pid=86488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "cinder-quobyte-f51604fe-b59d-4aee-8698-b1c6c76ae395" by "_copy_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-f51604fe-b59d-4aee-8698-b1c6c76ae395" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] snapshot: d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da, volume: f51604fe-b59d-4aee-8698-b1c6c76ae395, {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d219020-ca87-45a0-91f4-75f86027fa7a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:29 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da Jun 02 16:20:29 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:30 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da" returned: 0 in 1.047s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:30 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a84898d-bcf2-4d63-925f-314675394592(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:20:30 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 16:20:30 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Creating direct copy from snapshot {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 16:20:30 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[31755442-9d64-4ad4-a59f-de5e4c6b6510]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:30 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 Jun 02 16:20:30 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:31 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:20:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Flow 'volume_create_manager' (f12f72fc-50e5-4d95-9afd-a8412f95542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:20:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df5c3f6-0e21-4289-8874-fde9ce71809b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df5c3f6-0e21-4289-8874-fde9ce71809b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-947931078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a95ec19-26a3-4b84-9b93-8d1771d7562b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235b3fca83b048f2a39a7ca8e87d9e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:20:31Z,use_quota=True,user_id='6ebb1ed8ae264917a6fafc5bbe6f03e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749a03d3-cd69-431c-873d-5bdb7a4e9887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749a03d3-cd69-431c-873d-5bdb7a4e9887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f48ec1f-8ce6-4d4b-9161-d458d1015a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:31 devstack cinder-volume[86488]: DEBUG cinder.image.glance [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Creating Keystone auth plugin from conf {{(pid=86488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 16:20:31 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592" returned: 0 in 1.225s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:31 devstack cinder-volume[86488]: DEBUG cinder.utils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Path /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f51604fe-b59d-4aee-8698-b1c6c76ae395 not found in is_blk_device check {{(pid=86488) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 16:20:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f51604fe-b59d-4aee-8698-b1c6c76ae395 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:31 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f51604fe-b59d-4aee-8698-b1c6c76ae395 Jun 02 16:20:31 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f48ec1f-8ce6-4d4b-9161-d458d1015a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6a95ec19-26a3-4b84-9b93-8d1771d7562b', 'volume_name': 'volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b', 'volume_size': 1, 'image_id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '802a1494b5514d5c94e7154c7dda716e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'created_at': datetime.datetime(2026, 6, 2, 14, 3, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 3, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb30112f-a077-45d4-89f9-14745c38782a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb30112f-a077-45d4-89f9-14745c38782a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36eab7c2-0708-442e-93e5-3af9c87a4fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:31 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Volume 6a95ec19-26a3-4b84-9b93-8d1771d7562b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b', 'volume_size': 1, 'image_id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '802a1494b5514d5c94e7154c7dda716e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'created_at': datetime.datetime(2026, 6, 2, 14, 3, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 3, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 02 16:20:31 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Trying to clone 6a95ec19-26a3-4b84-9b93-8d1771d7562b from image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}]). {{(pid=86488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 02 16:20:32 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_u7nbemjjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 16:20:32 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Image download 20.69 MB at 20.69 MB/s Jun 02 16:20:32 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f6cb6c-dc90-4af4-a92b-4b7ea8ee1470]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_u7nbemjjdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:32 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_u7nbemjjdevstack@QuobyteHD Jun 02 16:20:32 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:33 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_u7nbemjjdevstack@QuobyteHD" returned: 0 in 1.295s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:33 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Temporary image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 is fetched for user 6ebb1ed8ae264917a6fafc5bbe6f03e7. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 16:20:33 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc76e809-c169-4376-a152-865f59a526f1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_u7nbemjjdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:34 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_u7nbemjjdevstack@QuobyteHD Jun 02 16:20:34 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:35 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_u7nbemjjdevstack@QuobyteHD" returned: 0 in 1.807s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:38 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f51604fe-b59d-4aee-8698-b1c6c76ae395" returned: 0 in 6.778s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:38 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f8a1e0-575d-42bc-9072-9c660b2fa1c8]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:38 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 Jun 02 16:20:38 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:39 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592" returned: 0 in 1.095s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:39 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Image conversion details: src /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592, size 1024.00 MB, duration 6.78 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f51604fe-b59d-4aee-8698-b1c6c76ae395 {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:20:39 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Converted 1024.00 MB image at 151.05 MB/s Jun 02 16:20:39 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f51604fe-b59d-4aee-8698-b1c6c76ae395 is being set with open permissions: ugo+rw Jun 02 16:20:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f51604fe-b59d-4aee-8698-b1c6c76ae395 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:39 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f51604fe-b59d-4aee-8698-b1c6c76ae395 Jun 02 16:20:39 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:39 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f51604fe-b59d-4aee-8698-b1c6c76ae395" returned: 0 in 0.739s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-f51604fe-b59d-4aee-8698-b1c6c76ae395" released by "_copy_volume_from_snapshot" :: held 11.048s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da-f51604fe-b59d-4aee-8698-b1c6c76ae395" released by "_create_volume_from_snapshot" :: held 11.092s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.114s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.247s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:39 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-947931078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a95ec19-26a3-4b84-9b93-8d1771d7562b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235b3fca83b048f2a39a7ca8e87d9e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:20:31Z,use_quota=True,user_id='6ebb1ed8ae264917a6fafc5bbe6f03e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:20:39 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Creating volume 6a95ec19-26a3-4b84-9b93-8d1771d7562b {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:20:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:39 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:20:39 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:20:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:39 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:20:39 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:20:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:40 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b 1073741824 Jun 02 16:20:40 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efd228c-6980-4ec4-a8c2-58702c08a466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f51604fe-b59d-4aee-8698-b1c6c76ae395', 'volume_size': 1, 'snapshot_id': 'd95f3e3d-cfd6-4900-bfa2-721cd3e8d7da'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665a6e96-78a4-4e27-86a5-69f166dc35e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:40 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Volume volume-f51604fe-b59d-4aee-8698-b1c6c76ae395 (f51604fe-b59d-4aee-8698-b1c6c76ae395): created successfully Jun 02 16:20:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665a6e96-78a4-4e27-86a5-69f166dc35e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Flow 'volume_create_manager' (0060a60d-10bf-4dfe-9999-2fbd898d0773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:20:40 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-bc6dfbe5-8f73-4afc-9863-ccd3982027f0 tempest-VolumesDeleteCascade-883593678 None] Created volume successfully. Jun 02 16:20:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "cinder-6a84898d-bcf2-4d63-925f-314675394592-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-6a84898d-bcf2-4d63-925f-314675394592-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Performing cascade delete. {{(pid=86488) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 02 16:20:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "cinder-d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "cinder-quobyte-6a84898d-bcf2-4d63-925f-314675394592" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-6a84898d-bcf2-4d63-925f-314675394592" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "cinder-quobyte-d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Deleting offline snapshot d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da of volume 6a84898d-bcf2-4d63-925f-314675394592 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:20:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] snapshot_file for this snap is: volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:20:40 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[db03bec7-e7b1-4e9d-b954-f7c1645d2eec]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:40 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da Jun 02 16:20:40 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:41 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b 1073741824" returned: 0 in 1.246s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:41 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b Jun 02 16:20:41 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:41 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da" returned: 0 in 0.992s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a84898d-bcf2-4d63-925f-314675394592(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:20:41 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[73817be0-046c-45e5-b220-877ce18e52bb]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:41 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 Jun 02 16:20:41 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:42 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b" returned: 0 in 0.783s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:20:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:42 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Attempting download of d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}])) to volume 6a95ec19-26a3-4b84-9b93-8d1771d7562b. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 16:20:42 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dc9c48-1882-4d77-bcf4-f098c3085017]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_zeefr33o {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:42 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_zeefr33o Jun 02 16:20:42 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:42 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592" returned: 0 in 0.817s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:42 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da Jun 02 16:20:42 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:42 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_zeefr33o" returned: 0 in 0.785s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_zeefr33o {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:43 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_zeefr33o Jun 02 16:20:43 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:43 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da" returned: 0 in 0.796s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:43 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da Jun 02 16:20:43 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:43 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_zeefr33o" returned: 1 in 0.798s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_zeefr33o' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:20:43 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa02acf9-1dfa-4b98-9134-e59ba8dd8f97]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_u7nbemjjdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:43 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_u7nbemjjdevstack@QuobyteHD Jun 02 16:20:43 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:44 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592.d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da" returned: 0 in 0.838s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:44 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da" released by "_delete_snapshot" :: held 3.603s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:44 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-6a84898d-bcf2-4d63-925f-314675394592" released by "delete_snapshot" :: held 3.642s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:44 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Created reservations ['66db22b4-7e74-4cd9-bf0e-8ed8f68a750b', '20bd82be-31ab-4aa9-a34a-d22c3331cf1c', '2ba2e3a3-d981-4a70-8a41-0329abe25508', 'bf0413a9-a796-4227-8f7d-428517f54bf0'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:20:44 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Delete snapshot completed successfully. Jun 02 16:20:44 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-d95f3e3d-cfd6-4900-bfa2-721cd3e8d7da-delete_snapshot" released by "delete_snapshot" :: held 3.844s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Snapshots deleted, issuing volume delete {{(pid=86488) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 02 16:20:44 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "cinder-quobyte-6a84898d-bcf2-4d63-925f-314675394592" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:44 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-6a84898d-bcf2-4d63-925f-314675394592" acquired by "delete_volume" :: waited 0.017s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:44 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed2bc5f-8429-4965-a5df-79d88dcedf99]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:44 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 Jun 02 16:20:44 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:44 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_u7nbemjjdevstack@QuobyteHD" returned: 0 in 0.907s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:44 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 was qcow2, converting to raw {{(pid=86488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 16:20:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_u7nbemjjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:44 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_u7nbemjjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b Jun 02 16:20:44 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:45 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592" returned: 0 in 0.892s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:45 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592 Jun 02 16:20:45 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:46 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a84898d-bcf2-4d63-925f-314675394592" returned: 0 in 0.852s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-6a84898d-bcf2-4d63-925f-314675394592" released by "delete_volume" :: held 1.868s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:46 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Created reservations ['a861e393-703e-45b0-8a58-d6b826defc5b', '40d3cdd9-fa2b-4ab0-94c5-fa3d1e07cdc3', 'c7c937bf-0067-4de8-974e-e0b080f61341', 'd751f954-4745-4904-af3e-9e5240789c3a'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:20:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:20:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:20:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:46 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:20:46 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:47 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.961s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:47 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:20:47 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Deleted volume successfully. Jun 02 16:20:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "cinder-f51604fe-b59d-4aee-8698-b1c6c76ae395-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:47 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52c741f9-44ca-4d19-bd8c-daf0af508d7d tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-6a84898d-bcf2-4d63-925f-314675394592-delete_volume" released by "delete_volume" :: held 7.077s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_u7nbemjjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b" returned: 0 in 2.871s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-f51604fe-b59d-4aee-8698-b1c6c76ae395-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:47 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_u7nbemjjdevstack@QuobyteHD, size 112.00 MB, duration 2.88 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:20:47 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Converted 112.00 MB image at 38.89 MB/s Jun 02 16:20:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:47 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b 1G Jun 02 16:20:47 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "cinder-quobyte-f51604fe-b59d-4aee-8698-b1c6c76ae395" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:20:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-f51604fe-b59d-4aee-8698-b1c6c76ae395" acquired by "delete_volume" :: waited 0.034s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:20:47 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6dcf4a-1c20-4474-8a5f-633535c7c519]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f51604fe-b59d-4aee-8698-b1c6c76ae395 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:48 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f51604fe-b59d-4aee-8698-b1c6c76ae395 Jun 02 16:20:48 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:48 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b 1G" returned: 0 in 0.901s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:48 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c6d1a1-6379-459f-9ff6-c76fab3ac2de]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:20:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:48 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b Jun 02 16:20:48 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:49 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f51604fe-b59d-4aee-8698-b1c6c76ae395" returned: 0 in 1.331s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f51604fe-b59d-4aee-8698-b1c6c76ae395 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:49 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f51604fe-b59d-4aee-8698-b1c6c76ae395 Jun 02 16:20:49 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:49 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b" returned: 0 in 1.039s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:49 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b Jun 02 16:20:49 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:49 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f51604fe-b59d-4aee-8698-b1c6c76ae395" returned: 0 in 0.725s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:49 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-quobyte-f51604fe-b59d-4aee-8698-b1c6c76ae395" released by "delete_volume" :: held 2.136s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:49 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:UPDATE=86,cinder:SELECT=88,cinder:INSERT=26,cinder:DELETE=8 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:20:49 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:INSERT=29,cinder:UPDATE=94,cinder:SELECT=74,cinder:DELETE=7 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:20:49 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] Created reservations ['57c65b7d-63b9-472d-94d6-c01ed20f0d4f', '00fa6d16-2d0d-42bc-83bf-b4ff268743e9', 'b7c47a3a-9e90-4309-9d9c-3ffbee71a7c3', 'fcb9647d-bece-4ac6-8495-84e91df955ff'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:50 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:20:50 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:50 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b" returned: 1 in 0.892s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Downloaded image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}])) to volume 6a95ec19-26a3-4b84-9b93-8d1771d7562b successfully. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Temporary image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 for user 6ebb1ed8ae264917a6fafc5bbe6f03e7 is deleted. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Marking volume 6a95ec19-26a3-4b84-9b93-8d1771d7562b as bootable. {{(pid=86488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Copying metadata from image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 to 6a95ec19-26a3-4b84-9b93-8d1771d7562b. {{(pid=86488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Creating volume glance metadata for volume 6a95ec19-26a3-4b84-9b93-8d1771d7562b backed by image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36eab7c2-0708-442e-93e5-3af9c87a4fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b', 'volume_size': 1, 'image_id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '802a1494b5514d5c94e7154c7dda716e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'created_at': datetime.datetime(2026, 6, 2, 14, 3, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 3, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3dedf30-cc17-4599-96fa-d880e63ce881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:50 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Volume volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b (6a95ec19-26a3-4b84-9b93-8d1771d7562b): created successfully Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3dedf30-cc17-4599-96fa-d880e63ce881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Flow 'volume_create_manager' (f12f72fc-50e5-4d95-9afd-a8412f95542f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:20:50 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f2b34353-b404-45f7-8483-b4e55c497c2f tempest-TestShelveInstance-6591655 None] Created volume successfully. Jun 02 16:20:50 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.779s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:20:50 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] Deleted volume successfully. Jun 02 16:20:50 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-da22197e-dd4b-4541-a7d3-8009eefef532 tempest-VolumesDeleteCascade-883593678 None] Lock "cinder-f51604fe-b59d-4aee-8698-b1c6c76ae395-delete_volume" released by "delete_volume" :: held 3.282s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Flow 'volume_create_manager' (ab5992ea-96aa-47ac-9dbc-b74973cbac84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd09d56-158b-4448-858a-d2292c5dc06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd09d56-158b-4448-858a-d2292c5dc06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-531011382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cfc4b9-ded6-4c63-9b75-cbb797340155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cdd0c5c1964433b91b978e1a79519c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:20:57Z,use_quota=True,user_id='ff7e9606b491441bacd1dafc47d08a06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019fe8f3-72cc-4497-b801-2d826f5cde62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019fe8f3-72cc-4497-b801-2d826f5cde62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6099e37c-4857-4496-b11c-4ef2d9862ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6099e37c-4857-4496-b11c-4ef2d9862ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62cfc4b9-ded6-4c63-9b75-cbb797340155', 'volume_name': 'volume-62cfc4b9-ded6-4c63-9b75-cbb797340155', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad3680c-9418-4299-a830-8b1aa2431fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad3680c-9418-4299-a830-8b1aa2431fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7866c12-409b-4ce8-9d00-647e467e7e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:20:57 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Volume 62cfc4b9-ded6-4c63-9b75-cbb797340155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62cfc4b9-ded6-4c63-9b75-cbb797340155', 'volume_size': 1} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-531011382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cfc4b9-ded6-4c63-9b75-cbb797340155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cdd0c5c1964433b91b978e1a79519c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:20:57Z,use_quota=True,user_id='ff7e9606b491441bacd1dafc47d08a06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Creating volume 62cfc4b9-ded6-4c63-9b75-cbb797340155 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:20:57 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:20:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62cfc4b9-ded6-4c63-9b75-cbb797340155 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:57 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62cfc4b9-ded6-4c63-9b75-cbb797340155 1073741824 Jun 02 16:20:57 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:58 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62cfc4b9-ded6-4c63-9b75-cbb797340155 1073741824" returned: 0 in 1.394s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62cfc4b9-ded6-4c63-9b75-cbb797340155 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:20:58 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62cfc4b9-ded6-4c63-9b75-cbb797340155 Jun 02 16:20:58 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:20:59 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Jun 02 16:20:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62cfc4b9-ded6-4c63-9b75-cbb797340155" returned: 0 in 1.045s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:20:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] <== create_volume: return (2585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:20:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.590s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7866c12-409b-4ce8-9d00-647e467e7e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62cfc4b9-ded6-4c63-9b75-cbb797340155', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee86d55-8c45-445d-a878-97c7cc4c7b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:21:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:00 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Volume volume-62cfc4b9-ded6-4c63-9b75-cbb797340155 (62cfc4b9-ded6-4c63-9b75-cbb797340155): created successfully Jun 02 16:21:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee86d55-8c45-445d-a878-97c7cc4c7b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:00 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:21:00 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Flow 'volume_create_manager' (ab5992ea-96aa-47ac-9dbc-b74973cbac84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:00 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-d3603b87-c1cb-4fdf-8fdd-25ada708ebf0 tempest-VolumesTransfersTest-1593804068 None] Created volume successfully. Jun 02 16:21:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-d146ed46-360c-4498-841c-de3c6383af28 req-4dc69e33-a863-4000-8f9b-b8d98ffb5943 tempest-TestShelveInstance-6591655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-d146ed46-360c-4498-841c-de3c6383af28 req-4dc69e33-a863-4000-8f9b-b8d98ffb5943 tempest-TestShelveInstance-6591655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:00 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f859aa3e-8a79-4996-9726-112e7dd59949]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-d146ed46-360c-4498-841c-de3c6383af28 req-4dc69e33-a863-4000-8f9b-b8d98ffb5943 tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:01 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.996s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:01 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:21:01 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b Jun 02 16:21:01 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:02 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f8682621-a16b-4f65-8f25-b73b905d2625 tempest-VolumesTransfersTest-748935946 None] Transfer volume completed successfully. Jun 02 16:21:02 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-d146ed46-360c-4498-841c-de3c6383af28 req-4dc69e33-a863-4000-8f9b-b8d98ffb5943 tempest-TestShelveInstance-6591655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b" returned: 0 in 1.320s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-d146ed46-360c-4498-841c-de3c6383af28 req-4dc69e33-a863-4000-8f9b-b8d98ffb5943 tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:02 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b Jun 02 16:21:02 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:03 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:21:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Flow 'volume_create_manager' (d311a5b2-c188-44f9-9a1e-a26c1fcb247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ea9ea6-8723-4b1d-81ea-b01080d91a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:04 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-d146ed46-360c-4498-841c-de3c6383af28 req-4dc69e33-a863-4000-8f9b-b8d98ffb5943 tempest-TestShelveInstance-6591655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b" returned: 1 in 1.746s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-d146ed46-360c-4498-841c-de3c6383af28 req-4dc69e33-a863-4000-8f9b-b8d98ffb5943 tempest-TestShelveInstance-6591655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-d146ed46-360c-4498-841c-de3c6383af28 req-4dc69e33-a863-4000-8f9b-b8d98ffb5943 tempest-TestShelveInstance-6591655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.189s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ea9ea6-8723-4b1d-81ea-b01080d91a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-735939245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b364b8-6679-4ef1-ab88-6f4434727ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa802bb16d24fc2a450202ef42449ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:04Z,use_quota=True,user_id='221e4947d7414584840c2af971fb10c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed05d75-db1b-493a-ac43-8124d864f2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed05d75-db1b-493a-ac43-8124d864f2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93f1f3a-dfcd-4d4b-a4c0-3ad4cae79d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93f1f3a-dfcd-4d4b-a4c0-3ad4cae79d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5b364b8-6679-4ef1-ab88-6f4434727ccf', 'volume_name': 'volume-b5b364b8-6679-4ef1-ab88-6f4434727ccf', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d3aad5-d7d7-4ae3-b08b-43faab6f2320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d3aad5-d7d7-4ae3-b08b-43faab6f2320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5df8a34-3466-4c9b-88d5-05827fa22e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:04 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Volume b5b364b8-6679-4ef1-ab88-6f4434727ccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5b364b8-6679-4ef1-ab88-6f4434727ccf', 'volume_size': 1} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-735939245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b364b8-6679-4ef1-ab88-6f4434727ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa802bb16d24fc2a450202ef42449ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:04Z,use_quota=True,user_id='221e4947d7414584840c2af971fb10c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Creating volume b5b364b8-6679-4ef1-ab88-6f4434727ccf {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:21:04 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b5b364b8-6679-4ef1-ab88-6f4434727ccf 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] Acquiring lock "cinder-62cfc4b9-ded6-4c63-9b75-cbb797340155-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:04 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b5b364b8-6679-4ef1-ab88-6f4434727ccf 1073741824 Jun 02 16:21:04 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] Lock "cinder-62cfc4b9-ded6-4c63-9b75-cbb797340155-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-d146ed46-360c-4498-841c-de3c6383af28 req-4dc69e33-a863-4000-8f9b-b8d98ffb5943 tempest-TestShelveInstance-6591655 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d4529b9-0fe1-43e3-af21-095831d8b81c', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] Acquiring lock "cinder-quobyte-62cfc4b9-ded6-4c63-9b75-cbb797340155" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] Lock "cinder-quobyte-62cfc4b9-ded6-4c63-9b75-cbb797340155" acquired by "delete_volume" :: waited 0.042s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0428262f-643b-4b05-8bbf-cb9743cf6994]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62cfc4b9-ded6-4c63-9b75-cbb797340155 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:04 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-d146ed46-360c-4498-841c-de3c6383af28 req-4dc69e33-a863-4000-8f9b-b8d98ffb5943 tempest-TestShelveInstance-6591655 None] attachment_update completed successfully. Jun 02 16:21:04 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62cfc4b9-ded6-4c63-9b75-cbb797340155 Jun 02 16:21:04 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:05 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b5b364b8-6679-4ef1-ab88-6f4434727ccf 1073741824" returned: 0 in 1.567s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b5b364b8-6679-4ef1-ab88-6f4434727ccf {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:05 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b5b364b8-6679-4ef1-ab88-6f4434727ccf Jun 02 16:21:05 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:06 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62cfc4b9-ded6-4c63-9b75-cbb797340155" returned: 0 in 1.590s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62cfc4b9-ded6-4c63-9b75-cbb797340155 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:06 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62cfc4b9-ded6-4c63-9b75-cbb797340155 Jun 02 16:21:06 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:06 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b5b364b8-6679-4ef1-ab88-6f4434727ccf" returned: 0 in 1.089s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] <== create_volume: return (2765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:21:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.770s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5df8a34-3466-4c9b-88d5-05827fa22e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5b364b8-6679-4ef1-ab88-6f4434727ccf', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01ef8ce-3785-4de8-86e6-62e471e2bb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:06 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Volume volume-b5b364b8-6679-4ef1-ab88-6f4434727ccf (b5b364b8-6679-4ef1-ab88-6f4434727ccf): created successfully Jun 02 16:21:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01ef8ce-3785-4de8-86e6-62e471e2bb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Flow 'volume_create_manager' (d311a5b2-c188-44f9-9a1e-a26c1fcb247d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:07 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-839bfe57-a226-48b6-af09-44ff56470ace tempest-VolumesActionsTest-1428956895 None] Created volume successfully. Jun 02 16:21:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bfc8db33-bcb5-47f9-822d-b86de9fc85aa tempest-VolumesActionsTest-1428956895 None] Acquiring lock "cinder-b5b364b8-6679-4ef1-ab88-6f4434727ccf" by "attach_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bfc8db33-bcb5-47f9-822d-b86de9fc85aa tempest-VolumesActionsTest-1428956895 None] Lock "cinder-b5b364b8-6679-4ef1-ab88-6f4434727ccf" acquired by "attach_volume" :: waited 0.041s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:07 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-bfc8db33-bcb5-47f9-822d-b86de9fc85aa tempest-VolumesActionsTest-1428956895 None] Attaching volume b5b364b8-6679-4ef1-ab88-6f4434727ccf to instance f0bb8fb6-e468-474f-9b9e-a6bb25fe853b at mountpoint /dev/vdb on host None. Jun 02 16:21:07 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62cfc4b9-ded6-4c63-9b75-cbb797340155" returned: 0 in 1.300s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] Lock "cinder-quobyte-62cfc4b9-ded6-4c63-9b75-cbb797340155" released by "delete_volume" :: held 2.959s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:07 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-bfc8db33-bcb5-47f9-822d-b86de9fc85aa tempest-VolumesActionsTest-1428956895 None] Attach volume completed successfully. Jun 02 16:21:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bfc8db33-bcb5-47f9-822d-b86de9fc85aa tempest-VolumesActionsTest-1428956895 None] Lock "cinder-b5b364b8-6679-4ef1-ab88-6f4434727ccf" released by "attach_volume" :: held 0.141s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:07 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] Created reservations ['3f7170b6-7a30-49a0-8ef0-983aa790db6f', 'fdb3d0f1-3bb1-42cd-8f96-bf0dad1cbeeb', 'dba8a2fd-4d1e-474b-87b9-3f6042af205e', '407576c3-2590-4fc1-8ca9-f163aa968186'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:21:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:07 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:21:07 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:21:08 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Flow 'volume_create_manager' (276a5f0b-9d33-4bef-99ae-8042a2496462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6074a91-9173-400c-a909-d6a7244f45ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.131s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:21:08 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] Deleted volume successfully. Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6074a91-9173-400c-a909-d6a7244f45ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-474144878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58c5767-5e7c-4331-bdbb-ef8f79c305eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cdd0c5c1964433b91b978e1a79519c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:09Z,use_quota=True,user_id='ff7e9606b491441bacd1dafc47d08a06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1dae72a-f545-4cce-a61b-e43cc6a0d31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1dae72a-f545-4cce-a61b-e43cc6a0d31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9712cbdd-833f-4432-bdb2-099db2e8c070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9712cbdd-833f-4432-bdb2-099db2e8c070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e58c5767-5e7c-4331-bdbb-ef8f79c305eb', 'volume_name': 'volume-e58c5767-5e7c-4331-bdbb-ef8f79c305eb', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fc30ff-4174-4714-a0e9-d7005627b908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fc30ff-4174-4714-a0e9-d7005627b908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa24c60-a1d5-4158-9daa-25f68b53dccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:08 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Volume e58c5767-5e7c-4331-bdbb-ef8f79c305eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e58c5767-5e7c-4331-bdbb-ef8f79c305eb', 'volume_size': 1} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-474144878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58c5767-5e7c-4331-bdbb-ef8f79c305eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cdd0c5c1964433b91b978e1a79519c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:09Z,use_quota=True,user_id='ff7e9606b491441bacd1dafc47d08a06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Creating volume e58c5767-5e7c-4331-bdbb-ef8f79c305eb {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:21:08 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e58c5767-5e7c-4331-bdbb-ef8f79c305eb 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-83b28508-5e9d-4d00-9b10-ddda28a47abe tempest-VolumesTransfersTest-475141321 None] Lock "cinder-62cfc4b9-ded6-4c63-9b75-cbb797340155-delete_volume" released by "delete_volume" :: held 4.647s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:08 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e58c5767-5e7c-4331-bdbb-ef8f79c305eb 1073741824 Jun 02 16:21:08 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:09 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-01101ac3-2670-4c79-9f2f-0fa7d341a6fc tempest-VolumesActionsTest-413695749 None] Terminate volume connection completed successfully. Jun 02 16:21:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-01101ac3-2670-4c79-9f2f-0fa7d341a6fc tempest-VolumesActionsTest-413695749 None] Acquiring lock "cinder-b5b364b8-6679-4ef1-ab88-6f4434727ccf-detach_volume" by "detach_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-01101ac3-2670-4c79-9f2f-0fa7d341a6fc tempest-VolumesActionsTest-413695749 None] Lock "cinder-b5b364b8-6679-4ef1-ab88-6f4434727ccf-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:09 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-01101ac3-2670-4c79-9f2f-0fa7d341a6fc tempest-VolumesActionsTest-413695749 None] Detaching volume b5b364b8-6679-4ef1-ab88-6f4434727ccf from instance f0bb8fb6-e468-474f-9b9e-a6bb25fe853b. Jun 02 16:21:09 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-01101ac3-2670-4c79-9f2f-0fa7d341a6fc tempest-VolumesActionsTest-413695749 None] Detach volume completed successfully. Jun 02 16:21:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-01101ac3-2670-4c79-9f2f-0fa7d341a6fc tempest-VolumesActionsTest-413695749 None] Lock "cinder-b5b364b8-6679-4ef1-ab88-6f4434727ccf-detach_volume" released by "detach_volume" :: held 0.107s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:10 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e58c5767-5e7c-4331-bdbb-ef8f79c305eb 1073741824" returned: 0 in 1.230s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e58c5767-5e7c-4331-bdbb-ef8f79c305eb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:10 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e58c5767-5e7c-4331-bdbb-ef8f79c305eb Jun 02 16:21:10 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e7001899-eeed-4fa5-a98c-0e041fbd79b7 tempest-VolumesActionsTest-1428956895 None] Acquiring lock "cinder-b5b364b8-6679-4ef1-ab88-6f4434727ccf-detach_volume" by "detach_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e7001899-eeed-4fa5-a98c-0e041fbd79b7 tempest-VolumesActionsTest-1428956895 None] Lock "cinder-b5b364b8-6679-4ef1-ab88-6f4434727ccf-detach_volume" acquired by "detach_volume" :: waited 0.052s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:10 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-e7001899-eeed-4fa5-a98c-0e041fbd79b7 tempest-VolumesActionsTest-1428956895 None] Volume detach called, but volume not attached. Jun 02 16:21:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e7001899-eeed-4fa5-a98c-0e041fbd79b7 tempest-VolumesActionsTest-1428956895 None] Lock "cinder-b5b364b8-6679-4ef1-ab88-6f4434727ccf-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:11 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e58c5767-5e7c-4331-bdbb-ef8f79c305eb" returned: 0 in 1.082s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:11 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] <== create_volume: return (2498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:21:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.501s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa24c60-a1d5-4158-9daa-25f68b53dccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e58c5767-5e7c-4331-bdbb-ef8f79c305eb', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1337840-20eb-4ccd-b497-4009636858a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:11 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Volume volume-e58c5767-5e7c-4331-bdbb-ef8f79c305eb (e58c5767-5e7c-4331-bdbb-ef8f79c305eb): created successfully Jun 02 16:21:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1337840-20eb-4ccd-b497-4009636858a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Flow 'volume_create_manager' (276a5f0b-9d33-4bef-99ae-8042a2496462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:11 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-4fd6cd43-c311-431e-b296-bc0a767f418c tempest-VolumesTransfersTest-1593804068 None] Created volume successfully. Jun 02 16:21:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] Acquiring lock "cinder-b5b364b8-6679-4ef1-ab88-6f4434727ccf-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] Lock "cinder-b5b364b8-6679-4ef1-ab88-6f4434727ccf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] Acquiring lock "cinder-quobyte-b5b364b8-6679-4ef1-ab88-6f4434727ccf" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] Lock "cinder-quobyte-b5b364b8-6679-4ef1-ab88-6f4434727ccf" acquired by "delete_volume" :: waited 0.045s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:11 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[caac7748-8015-41ba-90b1-d92ddee6c42f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b5b364b8-6679-4ef1-ab88-6f4434727ccf {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:11 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b5b364b8-6679-4ef1-ab88-6f4434727ccf Jun 02 16:21:11 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] Acquiring lock "cinder-e58c5767-5e7c-4331-bdbb-ef8f79c305eb-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] Lock "cinder-e58c5767-5e7c-4331-bdbb-ef8f79c305eb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] Acquiring lock "cinder-quobyte-e58c5767-5e7c-4331-bdbb-ef8f79c305eb" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] Lock "cinder-quobyte-e58c5767-5e7c-4331-bdbb-ef8f79c305eb" acquired by "delete_volume" :: waited 0.045s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:12 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef40291-11f1-4b6b-bf18-c5d2b6ba3b6a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e58c5767-5e7c-4331-bdbb-ef8f79c305eb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:13 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e58c5767-5e7c-4331-bdbb-ef8f79c305eb Jun 02 16:21:13 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:13 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b5b364b8-6679-4ef1-ab88-6f4434727ccf" returned: 0 in 1.771s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b5b364b8-6679-4ef1-ab88-6f4434727ccf {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:13 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b5b364b8-6679-4ef1-ab88-6f4434727ccf Jun 02 16:21:13 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:14 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e58c5767-5e7c-4331-bdbb-ef8f79c305eb" returned: 0 in 1.294s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e58c5767-5e7c-4331-bdbb-ef8f79c305eb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:14 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e58c5767-5e7c-4331-bdbb-ef8f79c305eb Jun 02 16:21:14 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:14 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b5b364b8-6679-4ef1-ab88-6f4434727ccf" returned: 0 in 0.822s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] Lock "cinder-quobyte-b5b364b8-6679-4ef1-ab88-6f4434727ccf" released by "delete_volume" :: held 2.717s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:14 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] Created reservations ['bd8ff138-e4da-46f9-8fdb-67f9a4ece638', '47970233-bac7-41e6-bf25-58803af6c671', '5ec65458-2266-41b4-97c3-8523434d84fe', 'b1792675-3fa4-42f1-ba89-3c4a22a670d5'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:21:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:14 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:21:14 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:15 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e58c5767-5e7c-4331-bdbb-ef8f79c305eb" returned: 0 in 1.031s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] Lock "cinder-quobyte-e58c5767-5e7c-4331-bdbb-ef8f79c305eb" released by "delete_volume" :: held 2.448s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:15 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] Created reservations ['34ba375f-5d07-4687-9d9f-d12eca843fdd', '19071bb6-9c63-47de-99e9-3550d81fcfc0', '935f2b5a-e8a8-4fed-91f8-8f35475b4f2a', 'de1228ad-e813-405d-b25c-8571f54111cf'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:21:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:15 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:15 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:15 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:21:15 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:16 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.433s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:16 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:21:16 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] Deleted volume successfully. Jun 02 16:21:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f0781e0a-b196-490e-81b0-20c3215155c6 tempest-VolumesActionsTest-1428956895 None] Lock "cinder-b5b364b8-6679-4ef1-ab88-6f4434727ccf-delete_volume" released by "delete_volume" :: held 4.588s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:16 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.191s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:16 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:21:16 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] Deleted volume successfully. Jun 02 16:21:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2ee0df9b-1233-4565-b0ab-90b8637045d6 tempest-VolumesTransfersTest-475141321 None] Lock "cinder-e58c5767-5e7c-4331-bdbb-ef8f79c305eb-delete_volume" released by "delete_volume" :: held 4.106s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Flow 'volume_create_manager' (3be1b6c4-0df6-42ff-85f7-f0519dbcdcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e709254e-638e-4bcc-a240-9e6901f551c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e709254e-638e-4bcc-a240-9e6901f551c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1679626169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1495d12-5a93-49a4-ac5a-c7d75f4ab59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414d01dff4654fb193191c88608f008a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:19Z,use_quota=True,user_id='96ac678acaad4c9f84e97d30a059cf5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90c90118-36ee-48b3-9cd8-3212e2d2908d),volume_type_id=90c90118-36ee-48b3-9cd8-3212e2d2908d)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6bd9cc-e9db-4eb2-91a7-4e4e2ba8231b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6bd9cc-e9db-4eb2-91a7-4e4e2ba8231b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64347e79-3c39-43c1-9640-0d017245c817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64347e79-3c39-43c1-9640-0d017245c817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1495d12-5a93-49a4-ac5a-c7d75f4ab59b', 'volume_name': 'volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77a2454-ded9-43cd-87e8-b1c0dd178703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77a2454-ded9-43cd-87e8-b1c0dd178703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737bd00e-088f-4e1f-aca8-4b2565ffaa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:19 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Volume a1495d12-5a93-49a4-ac5a-c7d75f4ab59b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b', 'volume_size': 1} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1679626169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1495d12-5a93-49a4-ac5a-c7d75f4ab59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414d01dff4654fb193191c88608f008a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:19Z,use_quota=True,user_id='96ac678acaad4c9f84e97d30a059cf5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90c90118-36ee-48b3-9cd8-3212e2d2908d),volume_type_id=90c90118-36ee-48b3-9cd8-3212e2d2908d)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Creating volume a1495d12-5a93-49a4-ac5a-c7d75f4ab59b {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:21:19 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:19 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b 1073741824 Jun 02 16:21:19 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Flow 'volume_create_manager' (235a959c-4d09-4e96-a28f-8ffee1f73206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf16552-0456-4afe-9854-d9a75c226458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf16552-0456-4afe-9854-d9a75c226458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1882069826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b10ba3e-1ee7-406e-8a0d-c1198ad7e569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414d01dff4654fb193191c88608f008a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:20Z,use_quota=True,user_id='96ac678acaad4c9f84e97d30a059cf5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b049d058-b824-4e93-bc3a-f3db85cbaee8),volume_type_id=b049d058-b824-4e93-bc3a-f3db85cbaee8)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339a8515-c7fe-475e-aa09-cb664d4bf1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339a8515-c7fe-475e-aa09-cb664d4bf1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4212b7c-0055-4e16-bf1a-00476afce685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4212b7c-0055-4e16-bf1a-00476afce685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b10ba3e-1ee7-406e-8a0d-c1198ad7e569', 'volume_name': 'volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a27c4567-62c6-45a8-a55d-8ef4038fad30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a27c4567-62c6-45a8-a55d-8ef4038fad30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad94076c-f246-49b4-8414-a1e31b0dd4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:20 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Volume 9b10ba3e-1ee7-406e-8a0d-c1198ad7e569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569', 'volume_size': 1} Jun 02 16:21:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:21 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b 1073741824" returned: 0 in 1.729s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:21 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b Jun 02 16:21:21 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:21 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:21:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Flow 'volume_create_manager' (fb04fc3b-3d09-4a05-b6f1-e66c5007dcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9191f616-4c1b-4d85-aa3f-d6352359c991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9191f616-4c1b-4d85-aa3f-d6352359c991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-352430077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3303e87e-635e-44cf-907f-06df6f2a7454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414d01dff4654fb193191c88608f008a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:21Z,use_quota=True,user_id='96ac678acaad4c9f84e97d30a059cf5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aafb9975-7c71-4e61-86f8-46b7b7fe0677),volume_type_id=aafb9975-7c71-4e61-86f8-46b7b7fe0677)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2deae0-d49a-498a-9a91-edacf3ec5622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2deae0-d49a-498a-9a91-edacf3ec5622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa16a7ff-4d02-4e26-b0b7-954fd789ce30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:21 devstack cinder-volume[86488]: DEBUG cinder.image.glance [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Creating Keystone auth plugin from conf {{(pid=86488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 16:21:22 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b" returned: 0 in 1.359s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] <== create_volume: return (3182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.184s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa16a7ff-4d02-4e26-b0b7-954fd789ce30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3303e87e-635e-44cf-907f-06df6f2a7454', 'volume_name': 'volume-3303e87e-635e-44cf-907f-06df6f2a7454', 'volume_size': 1, 'image_id': '905fd87b-3af8-4d11-b66b-8d5bd92441c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/905fd87b-3af8-4d11-b66b-8d5bd92441c1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1365147132', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '414d01dff4654fb193191c88608f008a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '905fd87b-3af8-4d11-b66b-8d5bd92441c1', 'created_at': datetime.datetime(2026, 6, 2, 14, 21, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 21, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/905fd87b-3af8-4d11-b66b-8d5bd92441c1/file', 'properties': {}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9141e14a-8e7d-4af9-8431-6bfdb7f739f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9141e14a-8e7d-4af9-8431-6bfdb7f739f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4b17ea-8217-4bfc-a757-a6bb0d3f82a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:22 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Volume 3303e87e-635e-44cf-907f-06df6f2a7454: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3303e87e-635e-44cf-907f-06df6f2a7454', 'volume_size': 1, 'image_id': '905fd87b-3af8-4d11-b66b-8d5bd92441c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/905fd87b-3af8-4d11-b66b-8d5bd92441c1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1365147132', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '414d01dff4654fb193191c88608f008a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '905fd87b-3af8-4d11-b66b-8d5bd92441c1', 'created_at': datetime.datetime(2026, 6, 2, 14, 21, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 21, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/905fd87b-3af8-4d11-b66b-8d5bd92441c1/file', 'properties': {}}, 'image_service': } Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Trying to clone 3303e87e-635e-44cf-907f-06df6f2a7454 from image 905fd87b-3af8-4d11-b66b-8d5bd92441c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/905fd87b-3af8-4d11-b66b-8d5bd92441c1', 'metadata': {}}]). {{(pid=86488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.593s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1882069826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b10ba3e-1ee7-406e-8a0d-c1198ad7e569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414d01dff4654fb193191c88608f008a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:20Z,use_quota=True,user_id='96ac678acaad4c9f84e97d30a059cf5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b049d058-b824-4e93-bc3a-f3db85cbaee8),volume_type_id=b049d058-b824-4e93-bc3a-f3db85cbaee8)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Creating volume 9b10ba3e-1ee7-406e-8a0d-c1198ad7e569 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:21:22 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:22 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569 1073741824 Jun 02 16:21:22 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737bd00e-088f-4e1f-aca8-4b2565ffaa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763cd4a6-3e93-45a9-8a1e-92b4339a02ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:22 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Volume volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b (a1495d12-5a93-49a4-ac5a-c7d75f4ab59b): created successfully Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763cd4a6-3e93-45a9-8a1e-92b4339a02ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Flow 'volume_create_manager' (3be1b6c4-0df6-42ff-85f7-f0519dbcdcaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:22 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-d05c6ec9-4344-4215-9ce9-0afdcb7c2bbd tempest-TestInstancesWithCinderVolumes-1552097342 None] Created volume successfully. Jun 02 16:21:24 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:21:24 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Flow 'volume_create_manager' (e5595d07-653f-49ff-8155-fb7b97a14770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b13957-f41e-4a5f-8167-f9a3ad13bea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569 1073741824" returned: 0 in 1.928s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b13957-f41e-4a5f-8167-f9a3ad13bea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1769223274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc62e6c1-0599-44a1-aef9-84ec4d486a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa802bb16d24fc2a450202ef42449ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:24Z,use_quota=True,user_id='221e4947d7414584840c2af971fb10c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88ad857-32c1-4d5f-8dc6-deeef674535b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88ad857-32c1-4d5f-8dc6-deeef674535b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8349b646-b799-4fa1-8f1b-581b8e25cfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8349b646-b799-4fa1-8f1b-581b8e25cfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc62e6c1-0599-44a1-aef9-84ec4d486a3e', 'volume_name': 'volume-cc62e6c1-0599-44a1-aef9-84ec4d486a3e', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b073e55b-3dcf-4fa6-b26f-cdfbafd1f1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b073e55b-3dcf-4fa6-b26f-cdfbafd1f1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047d18ae-2ec5-4388-8396-12631611c902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:24 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Volume cc62e6c1-0599-44a1-aef9-84ec4d486a3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc62e6c1-0599-44a1-aef9-84ec4d486a3e', 'volume_size': 1} Jun 02 16:21:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:24 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569 Jun 02 16:21:24 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:25 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569" returned: 0 in 0.757s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] <== create_volume: return (2780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:21:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.788s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.803s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1769223274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc62e6c1-0599-44a1-aef9-84ec4d486a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa802bb16d24fc2a450202ef42449ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:24Z,use_quota=True,user_id='221e4947d7414584840c2af971fb10c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:21:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Creating volume cc62e6c1-0599-44a1-aef9-84ec4d486a3e {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:21:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:21:25 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:21:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cc62e6c1-0599-44a1-aef9-84ec4d486a3e 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad94076c-f246-49b4-8414-a1e31b0dd4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40a1ced-965e-430b-8566-fed059733109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:25 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cc62e6c1-0599-44a1-aef9-84ec4d486a3e 1073741824 Jun 02 16:21:25 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:25 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Volume volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569 (9b10ba3e-1ee7-406e-8a0d-c1198ad7e569): created successfully Jun 02 16:21:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40a1ced-965e-430b-8566-fed059733109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Flow 'volume_create_manager' (235a959c-4d09-4e96-a28f-8ffee1f73206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:25 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-121afcc0-8eae-4778-9d25-3b012dba032c tempest-TestInstancesWithCinderVolumes-1552097342 None] Created volume successfully. Jun 02 16:21:26 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cc62e6c1-0599-44a1-aef9-84ec4d486a3e 1073741824" returned: 0 in 1.254s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cc62e6c1-0599-44a1-aef9-84ec4d486a3e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:26 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cc62e6c1-0599-44a1-aef9-84ec4d486a3e Jun 02 16:21:26 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:27 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cc62e6c1-0599-44a1-aef9-84ec4d486a3e" returned: 0 in 0.795s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:27 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] <== create_volume: return (2131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:21:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.134s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047d18ae-2ec5-4388-8396-12631611c902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc62e6c1-0599-44a1-aef9-84ec4d486a3e', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c17b8e4-6d97-43c0-bce9-1ca8b2863be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:27 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Volume volume-cc62e6c1-0599-44a1-aef9-84ec4d486a3e (cc62e6c1-0599-44a1-aef9-84ec4d486a3e): created successfully Jun 02 16:21:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c17b8e4-6d97-43c0-bce9-1ca8b2863be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Flow 'volume_create_manager' (e5595d07-653f-49ff-8155-fb7b97a14770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:27 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-89c4d825-ba73-4617-93a6-c6d69b910118 tempest-VolumesActionsTest-1428956895 None] Created volume successfully. Jun 02 16:21:27 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_905fd87b-3af8-4d11-b66b-8d5bd92441c1_4q08io50devstack@QuobyteHD, size 20.69 MB, duration 5.03 sec {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 16:21:27 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Image download 20.69 MB at 4.11 MB/s Jun 02 16:21:27 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90e48d4-bf68-45be-90fa-7cd340329067]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_905fd87b-3af8-4d11-b66b-8d5bd92441c1_4q08io50devstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:27 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_905fd87b-3af8-4d11-b66b-8d5bd92441c1_4q08io50devstack@QuobyteHD Jun 02 16:21:27 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] Acquiring lock "cinder-cc62e6c1-0599-44a1-aef9-84ec4d486a3e-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] Lock "cinder-cc62e6c1-0599-44a1-aef9-84ec4d486a3e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] Acquiring lock "cinder-quobyte-cc62e6c1-0599-44a1-aef9-84ec4d486a3e" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] Lock "cinder-quobyte-cc62e6c1-0599-44a1-aef9-84ec4d486a3e" acquired by "delete_volume" :: waited 0.023s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:28 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc49363-5dd7-4cc6-add1-e43612f275e5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cc62e6c1-0599-44a1-aef9-84ec4d486a3e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:28 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cc62e6c1-0599-44a1-aef9-84ec4d486a3e Jun 02 16:21:28 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:28 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_905fd87b-3af8-4d11-b66b-8d5bd92441c1_4q08io50devstack@QuobyteHD" returned: 0 in 0.892s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:28 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Temporary image 905fd87b-3af8-4d11-b66b-8d5bd92441c1 is fetched for user 96ac678acaad4c9f84e97d30a059cf5c. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 16:21:28 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cbeb33-afb4-4809-bc35-5c6b417859c3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_905fd87b-3af8-4d11-b66b-8d5bd92441c1_4q08io50devstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:28 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_905fd87b-3af8-4d11-b66b-8d5bd92441c1_4q08io50devstack@QuobyteHD Jun 02 16:21:28 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Flow 'volume_create_manager' (2d7b46dd-19d1-47de-8b4f-9b87b38e8d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47169e8a-b71e-49d3-8a45-d2b14d8b5ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47169e8a-b71e-49d3-8a45-d2b14d8b5ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1176010364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df4ae97-b5f5-456d-9588-51b43daa7048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='311357974a7d4140a5d2f9976344110b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:29Z,use_quota=True,user_id='ad653ce81b574d1dbd2ad208059abeec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec28f2f-504b-47c2-969d-fad360240cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec28f2f-504b-47c2-969d-fad360240cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ef543b-b370-4180-894d-9edee7c064b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ef543b-b370-4180-894d-9edee7c064b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0df4ae97-b5f5-456d-9588-51b43daa7048', 'volume_name': 'volume-0df4ae97-b5f5-456d-9588-51b43daa7048', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd679b07-445e-4268-848d-08acc92fb361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd679b07-445e-4268-848d-08acc92fb361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e70c2e-1b21-47b8-96fc-809329b1d50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:29 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Volume 0df4ae97-b5f5-456d-9588-51b43daa7048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0df4ae97-b5f5-456d-9588-51b43daa7048', 'volume_size': 1} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1176010364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df4ae97-b5f5-456d-9588-51b43daa7048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='311357974a7d4140a5d2f9976344110b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:29Z,use_quota=True,user_id='ad653ce81b574d1dbd2ad208059abeec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Creating volume 0df4ae97-b5f5-456d-9588-51b43daa7048 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:21:29 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0df4ae97-b5f5-456d-9588-51b43daa7048 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:29 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:29 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0df4ae97-b5f5-456d-9588-51b43daa7048 1073741824 Jun 02 16:21:29 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cc62e6c1-0599-44a1-aef9-84ec4d486a3e" returned: 0 in 1.014s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cc62e6c1-0599-44a1-aef9-84ec4d486a3e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:29 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cc62e6c1-0599-44a1-aef9-84ec4d486a3e Jun 02 16:21:29 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:29 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_905fd87b-3af8-4d11-b66b-8d5bd92441c1_4q08io50devstack@QuobyteHD" returned: 0 in 0.870s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:30 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-cc62e6c1-0599-44a1-aef9-84ec4d486a3e" returned: 0 in 0.809s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:30 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] Lock "cinder-quobyte-cc62e6c1-0599-44a1-aef9-84ec4d486a3e" released by "delete_volume" :: held 1.892s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:30 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] Created reservations ['1318aad4-1de3-4661-a973-eb1116437481', '6b7d10b9-c9b8-4510-89e8-8cbef477ecd6', '5c8a0279-00c4-4826-92be-6ba062bfe2ca', 'e6c0a6ca-ad9d-4e45-8143-94b7a6d514e0'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:21:30 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0df4ae97-b5f5-456d-9588-51b43daa7048 1073741824" returned: 0 in 0.955s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0df4ae97-b5f5-456d-9588-51b43daa7048 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:30 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:30 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0df4ae97-b5f5-456d-9588-51b43daa7048 Jun 02 16:21:30 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:30 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:30 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:21:30 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:31 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0df4ae97-b5f5-456d-9588-51b43daa7048" returned: 0 in 0.622s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.453s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-352430077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3303e87e-635e-44cf-907f-06df6f2a7454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414d01dff4654fb193191c88608f008a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:21Z,use_quota=True,user_id='96ac678acaad4c9f84e97d30a059cf5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aafb9975-7c71-4e61-86f8-46b7b7fe0677),volume_type_id=aafb9975-7c71-4e61-86f8-46b7b7fe0677)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Creating volume 3303e87e-635e-44cf-907f-06df6f2a7454 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:21:31 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:21:31 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 1073741824 Jun 02 16:21:31 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Flow 'volume_create_manager' (4ae48a63-a433-43c6-ac36-7cd277fdeebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53067131-ab39-41df-8ba2-6c403557419a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e70c2e-1b21-47b8-96fc-809329b1d50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0df4ae97-b5f5-456d-9588-51b43daa7048', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9339c6-379d-4f23-8f37-63a901b9ccff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:31 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53067131-ab39-41df-8ba2-6c403557419a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-358535289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae9015f1-803d-43cf-a5bc-8b8c2b52a501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa802bb16d24fc2a450202ef42449ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:31Z,use_quota=True,user_id='221e4947d7414584840c2af971fb10c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9086b98c-d740-4640-b99b-708c775fb900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9086b98c-d740-4640-b99b-708c775fb900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a691ab97-61b4-4d39-b727-8a92fdc6317a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a691ab97-61b4-4d39-b727-8a92fdc6317a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae9015f1-803d-43cf-a5bc-8b8c2b52a501', 'volume_name': 'volume-ae9015f1-803d-43cf-a5bc-8b8c2b52a501', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f7ba0b-278b-4627-9709-9be833bf9f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f7ba0b-278b-4627-9709-9be833bf9f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061c0234-8c74-41e8-a14c-b27dcbc1f44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:31 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Volume ae9015f1-803d-43cf-a5bc-8b8c2b52a501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae9015f1-803d-43cf-a5bc-8b8c2b52a501', 'volume_size': 1} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.724s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:21:31 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] Deleted volume successfully. Jun 02 16:21:31 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Volume volume-0df4ae97-b5f5-456d-9588-51b43daa7048 (0df4ae97-b5f5-456d-9588-51b43daa7048): created successfully Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9339c6-379d-4f23-8f37-63a901b9ccff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Flow 'volume_create_manager' (2d7b46dd-19d1-47de-8b4f-9b87b38e8d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:31 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-2ae951cb-73db-4a08-8e19-e2734cf8edc4 tempest-VolumesTransfersV355Test-1149250914 None] Created volume successfully. Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8d2107c7-0eb6-45d9-885d-c61b42639e64 tempest-VolumesActionsTest-413695749 None] Lock "cinder-cc62e6c1-0599-44a1-aef9-84ec4d486a3e-delete_volume" released by "delete_volume" :: held 2.903s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:31 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-dc226c20-dc32-40f5-98a9-9d3e06e888a5 tempest-VolumesTransfersV355Test-1380337991 None] Transfer volume completed successfully. Jun 02 16:21:31 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 1073741824" returned: 0 in 0.891s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:32 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 Jun 02 16:21:32 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:32 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454" returned: 0 in 0.604s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.421s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-358535289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae9015f1-803d-43cf-a5bc-8b8c2b52a501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa802bb16d24fc2a450202ef42449ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:31Z,use_quota=True,user_id='221e4947d7414584840c2af971fb10c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Creating volume ae9015f1-803d-43cf-a5bc-8b8c2b52a501 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:21:32 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ae9015f1-803d-43cf-a5bc-8b8c2b52a501 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:32 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ae9015f1-803d-43cf-a5bc-8b8c2b52a501 1073741824 Jun 02 16:21:32 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Attempting download of 905fd87b-3af8-4d11-b66b-8d5bd92441c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/905fd87b-3af8-4d11-b66b-8d5bd92441c1', 'metadata': {}}])) to volume 3303e87e-635e-44cf-907f-06df6f2a7454. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bb74ca-d32a-4bcb-b821-98c07f583ff5]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_905fd87b-3af8-4d11-b66b-8d5bd92441c1_73olgyvt {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:32 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_905fd87b-3af8-4d11-b66b-8d5bd92441c1_73olgyvt Jun 02 16:21:32 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] Acquiring lock "cinder-0df4ae97-b5f5-456d-9588-51b43daa7048-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] Lock "cinder-0df4ae97-b5f5-456d-9588-51b43daa7048-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] Acquiring lock "cinder-quobyte-0df4ae97-b5f5-456d-9588-51b43daa7048" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] Lock "cinder-quobyte-0df4ae97-b5f5-456d-9588-51b43daa7048" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:33 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a99582-4e30-40cc-9a41-4803738fb60a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0df4ae97-b5f5-456d-9588-51b43daa7048 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:33 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0df4ae97-b5f5-456d-9588-51b43daa7048 Jun 02 16:21:33 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:33 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_905fd87b-3af8-4d11-b66b-8d5bd92441c1_73olgyvt" returned: 0 in 0.732s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_905fd87b-3af8-4d11-b66b-8d5bd92441c1_73olgyvt {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:33 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ae9015f1-803d-43cf-a5bc-8b8c2b52a501 1073741824" returned: 0 in 0.867s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ae9015f1-803d-43cf-a5bc-8b8c2b52a501 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:33 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ae9015f1-803d-43cf-a5bc-8b8c2b52a501 Jun 02 16:21:33 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:33 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_905fd87b-3af8-4d11-b66b-8d5bd92441c1_73olgyvt Jun 02 16:21:33 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:33 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0df4ae97-b5f5-456d-9588-51b43daa7048" returned: 0 in 0.819s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0df4ae97-b5f5-456d-9588-51b43daa7048 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:33 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0df4ae97-b5f5-456d-9588-51b43daa7048 Jun 02 16:21:33 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:34 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ae9015f1-803d-43cf-a5bc-8b8c2b52a501" returned: 0 in 0.631s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061c0234-8c74-41e8-a14c-b27dcbc1f44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae9015f1-803d-43cf-a5bc-8b8c2b52a501', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768034d0-677c-4b65-89df-826ae697d027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:34 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Volume volume-ae9015f1-803d-43cf-a5bc-8b8c2b52a501 (ae9015f1-803d-43cf-a5bc-8b8c2b52a501): created successfully Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768034d0-677c-4b65-89df-826ae697d027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Flow 'volume_create_manager' (4ae48a63-a433-43c6-ac36-7cd277fdeebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:34 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-bf97bad1-937a-41b9-aedf-07f75b1b14f7 tempest-VolumesActionsTest-1428956895 None] Created volume successfully. Jun 02 16:21:34 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_905fd87b-3af8-4d11-b66b-8d5bd92441c1_73olgyvt" returned: 1 in 0.804s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_905fd87b-3af8-4d11-b66b-8d5bd92441c1_73olgyvt' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[041fbcb6-1b88-4314-aee6-8abbfab61781]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_905fd87b-3af8-4d11-b66b-8d5bd92441c1_4q08io50devstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:34 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_905fd87b-3af8-4d11-b66b-8d5bd92441c1_4q08io50devstack@QuobyteHD Jun 02 16:21:34 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:34 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0df4ae97-b5f5-456d-9588-51b43daa7048" returned: 0 in 0.648s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] Lock "cinder-quobyte-0df4ae97-b5f5-456d-9588-51b43daa7048" released by "delete_volume" :: held 1.510s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] Created reservations ['1f54fbc8-e1de-411c-bf2a-aae1175b3b09', '18824420-820a-4808-8393-9e075820d67f', '4620aefb-dc2d-4265-9323-fa051a3f0500', '74625d69-1b06-434a-b3c5-34050436deaf'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:34 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:21:34 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:34 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_905fd87b-3af8-4d11-b66b-8d5bd92441c1_4q08io50devstack@QuobyteHD" returned: 0 in 0.660s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] 905fd87b-3af8-4d11-b66b-8d5bd92441c1 was qcow2, converting to raw {{(pid=86488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 16:21:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_905fd87b-3af8-4d11-b66b-8d5bd92441c1_4q08io50devstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:34 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_905fd87b-3af8-4d11-b66b-8d5bd92441c1_4q08io50devstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 Jun 02 16:21:34 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:35 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.617s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:21:35 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] Deleted volume successfully. Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-73451b15-b4f8-483e-901f-4a1ed2a8608b tempest-VolumesTransfersV355Test-1105623338 None] Lock "cinder-0df4ae97-b5f5-456d-9588-51b43daa7048-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] Acquiring lock "cinder-ae9015f1-803d-43cf-a5bc-8b8c2b52a501-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] Lock "cinder-ae9015f1-803d-43cf-a5bc-8b8c2b52a501-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] Acquiring lock "cinder-quobyte-ae9015f1-803d-43cf-a5bc-8b8c2b52a501" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] Lock "cinder-quobyte-ae9015f1-803d-43cf-a5bc-8b8c2b52a501" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcb66ff-0aac-4839-9169-656ffd9516e0]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ae9015f1-803d-43cf-a5bc-8b8c2b52a501 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:21:35 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ae9015f1-803d-43cf-a5bc-8b8c2b52a501 Jun 02 16:21:35 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Flow 'volume_create_manager' (9d8d0d0b-fc02-4c95-89ea-8156b920c298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80393a62-3627-4b37-a606-b1d387b1b086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80393a62-3627-4b37-a606-b1d387b1b086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2114288488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a5d3e9-b30c-4860-aae5-59510f1fd134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='311357974a7d4140a5d2f9976344110b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:36Z,use_quota=True,user_id='ad653ce81b574d1dbd2ad208059abeec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ae3132-9c57-420e-93a1-0d426340367d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ae3132-9c57-420e-93a1-0d426340367d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (071a8621-9d32-4511-8174-dea60f283f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (071a8621-9d32-4511-8174-dea60f283f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a5d3e9-b30c-4860-aae5-59510f1fd134', 'volume_name': 'volume-f9a5d3e9-b30c-4860-aae5-59510f1fd134', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a66842c-25d2-4e31-a77c-17ca950828f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a66842c-25d2-4e31-a77c-17ca950828f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9931e64-d20d-4a7c-b891-ebab86b99a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:35 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Volume f9a5d3e9-b30c-4860-aae5-59510f1fd134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a5d3e9-b30c-4860-aae5-59510f1fd134', 'volume_size': 1} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2114288488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a5d3e9-b30c-4860-aae5-59510f1fd134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='311357974a7d4140a5d2f9976344110b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:36Z,use_quota=True,user_id='ad653ce81b574d1dbd2ad208059abeec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Creating volume f9a5d3e9-b30c-4860-aae5-59510f1fd134 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:21:35 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:21:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f9a5d3e9-b30c-4860-aae5-59510f1fd134 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:35 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f9a5d3e9-b30c-4860-aae5-59510f1fd134 1073741824 Jun 02 16:21:35 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:36 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ae9015f1-803d-43cf-a5bc-8b8c2b52a501" returned: 0 in 0.921s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ae9015f1-803d-43cf-a5bc-8b8c2b52a501 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:36 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ae9015f1-803d-43cf-a5bc-8b8c2b52a501 Jun 02 16:21:36 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:36 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f9a5d3e9-b30c-4860-aae5-59510f1fd134 1073741824" returned: 0 in 1.148s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f9a5d3e9-b30c-4860-aae5-59510f1fd134 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:37 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f9a5d3e9-b30c-4860-aae5-59510f1fd134 Jun 02 16:21:37 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:37 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ae9015f1-803d-43cf-a5bc-8b8c2b52a501" returned: 0 in 0.686s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] Lock "cinder-quobyte-ae9015f1-803d-43cf-a5bc-8b8c2b52a501" released by "delete_volume" :: held 1.671s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] Created reservations ['03e43190-97d0-4065-8013-77f29db45139', 'ae7d471d-8e42-4c3f-bba2-b890d4cc95b3', 'cf82c0c5-aaf0-46e7-bdc4-7ab29a72950f', '52e576c5-8727-4c04-a075-09f7a0bfc18a'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:21:37 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_905fd87b-3af8-4d11-b66b-8d5bd92441c1_4q08io50devstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454" returned: 0 in 2.451s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_905fd87b-3af8-4d11-b66b-8d5bd92441c1_4q08io50devstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:21:37 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Converted 112.00 MB image at 45.62 MB/s Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:37 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 1G Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:37 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:37 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:21:37 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:37 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f9a5d3e9-b30c-4860-aae5-59510f1fd134" returned: 0 in 0.710s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9931e64-d20d-4a7c-b891-ebab86b99a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a5d3e9-b30c-4860-aae5-59510f1fd134', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84081685-35c6-4508-a3e5-67326b0606ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:37 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Volume volume-f9a5d3e9-b30c-4860-aae5-59510f1fd134 (f9a5d3e9-b30c-4860-aae5-59510f1fd134): created successfully Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84081685-35c6-4508-a3e5-67326b0606ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:37 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Flow 'volume_create_manager' (9d8d0d0b-fc02-4c95-89ea-8156b920c298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:37 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-44a172ce-c3d4-4ee5-9bae-5d85173d4f65 tempest-VolumesTransfersV355Test-1149250914 None] Created volume successfully. Jun 02 16:21:38 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.713s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:21:38 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] Deleted volume successfully. Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dffc9177-9795-4499-8c45-c076e1095ad8 tempest-VolumesActionsTest-413695749 None] Lock "cinder-ae9015f1-803d-43cf-a5bc-8b8c2b52a501-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:38 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 1G" returned: 0 in 0.833s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c791c00-3531-491c-9765-b0ba27fc9338]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:38 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 Jun 02 16:21:38 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Flow 'volume_create_manager' (d1136b0f-5ec4-4bb4-83a9-3eefce0cb2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ce2109-3f25-4e08-892b-de916f41271f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ce2109-3f25-4e08-892b-de916f41271f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-637025560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a0aee2-a11b-42fd-9953-2c70d69b77db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa802bb16d24fc2a450202ef42449ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:38Z,use_quota=True,user_id='221e4947d7414584840c2af971fb10c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d750b2a7-e1d9-4ea1-9f0d-d2f32b001f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d750b2a7-e1d9-4ea1-9f0d-d2f32b001f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (747b39f3-9108-4e82-9a1c-af31902eb6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (747b39f3-9108-4e82-9a1c-af31902eb6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0a0aee2-a11b-42fd-9953-2c70d69b77db', 'volume_name': 'volume-d0a0aee2-a11b-42fd-9953-2c70d69b77db', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf0c896-a3e8-49db-a915-0b3dd5e9cf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf0c896-a3e8-49db-a915-0b3dd5e9cf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f49495-b762-426b-958c-278b49a171c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:38 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Volume d0a0aee2-a11b-42fd-9953-2c70d69b77db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0a0aee2-a11b-42fd-9953-2c70d69b77db', 'volume_size': 1} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-637025560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a0aee2-a11b-42fd-9953-2c70d69b77db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa802bb16d24fc2a450202ef42449ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:38Z,use_quota=True,user_id='221e4947d7414584840c2af971fb10c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Creating volume d0a0aee2-a11b-42fd-9953-2c70d69b77db {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:21:38 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:21:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d0a0aee2-a11b-42fd-9953-2c70d69b77db 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:38 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d0a0aee2-a11b-42fd-9953-2c70d69b77db 1073741824 Jun 02 16:21:38 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:39 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454" returned: 0 in 0.802s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:39 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 Jun 02 16:21:39 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] Acquiring lock "cinder-f9a5d3e9-b30c-4860-aae5-59510f1fd134-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] Lock "cinder-f9a5d3e9-b30c-4860-aae5-59510f1fd134-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] Acquiring lock "cinder-quobyte-f9a5d3e9-b30c-4860-aae5-59510f1fd134" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] Lock "cinder-quobyte-f9a5d3e9-b30c-4860-aae5-59510f1fd134" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[796c1a34-4fbe-44ab-90e0-3df1d7f596fa]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f9a5d3e9-b30c-4860-aae5-59510f1fd134 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:39 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f9a5d3e9-b30c-4860-aae5-59510f1fd134 Jun 02 16:21:39 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:39 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d0a0aee2-a11b-42fd-9953-2c70d69b77db 1073741824" returned: 0 in 1.008s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d0a0aee2-a11b-42fd-9953-2c70d69b77db {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:39 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d0a0aee2-a11b-42fd-9953-2c70d69b77db Jun 02 16:21:39 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:39 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454" returned: 1 in 0.813s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Downloaded image 905fd87b-3af8-4d11-b66b-8d5bd92441c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/905fd87b-3af8-4d11-b66b-8d5bd92441c1', 'metadata': {}}])) to volume 3303e87e-635e-44cf-907f-06df6f2a7454 successfully. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Temporary image 905fd87b-3af8-4d11-b66b-8d5bd92441c1 for user 96ac678acaad4c9f84e97d30a059cf5c is deleted. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Marking volume 3303e87e-635e-44cf-907f-06df6f2a7454 as bootable. {{(pid=86488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Copying metadata from image 905fd87b-3af8-4d11-b66b-8d5bd92441c1 to 3303e87e-635e-44cf-907f-06df6f2a7454. {{(pid=86488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Creating volume glance metadata for volume 3303e87e-635e-44cf-907f-06df6f2a7454 backed by image 905fd87b-3af8-4d11-b66b-8d5bd92441c1 with: {'image_id': '905fd87b-3af8-4d11-b66b-8d5bd92441c1', 'image_name': 'tempest-scenario-img--1365147132', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 16:21:39 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4b17ea-8217-4bfc-a757-a6bb0d3f82a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3303e87e-635e-44cf-907f-06df6f2a7454', 'volume_size': 1, 'image_id': '905fd87b-3af8-4d11-b66b-8d5bd92441c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/905fd87b-3af8-4d11-b66b-8d5bd92441c1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1365147132', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '414d01dff4654fb193191c88608f008a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '905fd87b-3af8-4d11-b66b-8d5bd92441c1', 'created_at': datetime.datetime(2026, 6, 2, 14, 21, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 21, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/905fd87b-3af8-4d11-b66b-8d5bd92441c1/file', 'properties': {}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf2447a-d158-4356-bf6d-e48d5065aa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:40 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Volume volume-3303e87e-635e-44cf-907f-06df6f2a7454 (3303e87e-635e-44cf-907f-06df6f2a7454): created successfully Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf2447a-d158-4356-bf6d-e48d5065aa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Flow 'volume_create_manager' (fb04fc3b-3d09-4a05-b6f1-e66c5007dcf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:40 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-d9c0b1e2-f281-4c13-bba9-243cce20269a tempest-TestInstancesWithCinderVolumes-1552097342 None] Created volume successfully. Jun 02 16:21:40 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f9a5d3e9-b30c-4860-aae5-59510f1fd134" returned: 0 in 0.750s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f9a5d3e9-b30c-4860-aae5-59510f1fd134 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:40 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f9a5d3e9-b30c-4860-aae5-59510f1fd134 Jun 02 16:21:40 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:40 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d0a0aee2-a11b-42fd-9953-2c70d69b77db" returned: 0 in 0.654s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f49495-b762-426b-958c-278b49a171c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a0aee2-a11b-42fd-9953-2c70d69b77db', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ba9071-aa79-44f0-ba39-70cc60326fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:40 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Volume volume-d0a0aee2-a11b-42fd-9953-2c70d69b77db (d0a0aee2-a11b-42fd-9953-2c70d69b77db): created successfully Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ba9071-aa79-44f0-ba39-70cc60326fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Flow 'volume_create_manager' (d1136b0f-5ec4-4bb4-83a9-3eefce0cb2bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:40 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-cd123846-9604-436d-95e6-c0079fa849e8 tempest-VolumesActionsTest-1428956895 None] Created volume successfully. Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] Acquiring lock "cinder-d0a0aee2-a11b-42fd-9953-2c70d69b77db-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] Lock "cinder-d0a0aee2-a11b-42fd-9953-2c70d69b77db-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] Acquiring lock "cinder-quobyte-d0a0aee2-a11b-42fd-9953-2c70d69b77db" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] Lock "cinder-quobyte-d0a0aee2-a11b-42fd-9953-2c70d69b77db" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc1b416-0db9-46b2-8e1c-3507468bb068]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d0a0aee2-a11b-42fd-9953-2c70d69b77db {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:40 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f9a5d3e9-b30c-4860-aae5-59510f1fd134" returned: 0 in 0.649s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] Lock "cinder-quobyte-f9a5d3e9-b30c-4860-aae5-59510f1fd134" released by "delete_volume" :: held 1.444s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:40 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d0a0aee2-a11b-42fd-9953-2c70d69b77db Jun 02 16:21:40 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] Created reservations ['174d3f38-81d4-4cae-87f5-3af4add9499f', '9a56b466-9123-40f6-9bdd-bee7ff38bdeb', '6e5cc6fd-abba-414f-819c-02ab380fb069', 'b72afe3f-f212-4cb1-b8db-81ad8738e047'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:40 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:21:40 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:41 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d0a0aee2-a11b-42fd-9953-2c70d69b77db" returned: 0 in 0.823s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d0a0aee2-a11b-42fd-9953-2c70d69b77db {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:41 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d0a0aee2-a11b-42fd-9953-2c70d69b77db Jun 02 16:21:41 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:41 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.673s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:41 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:21:41 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] Deleted volume successfully. Jun 02 16:21:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0cdd3624-2bc4-46b5-b69c-5992464174a7 tempest-VolumesTransfersV355Test-1105623338 None] Lock "cinder-f9a5d3e9-b30c-4860-aae5-59510f1fd134-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:42 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d0a0aee2-a11b-42fd-9953-2c70d69b77db" returned: 0 in 0.725s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] Lock "cinder-quobyte-d0a0aee2-a11b-42fd-9953-2c70d69b77db" released by "delete_volume" :: held 1.593s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:42 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] Created reservations ['52b418e3-b95c-4eca-9fbb-7a3a86bc4122', '0c9aa7f1-03ba-45bd-b4f6-b978d68bddc2', '06d491d0-6225-4d27-a44e-b18a58cb876e', '59e565e6-687d-4d7c-b549-c8eb046e0be6'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:21:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:42 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:21:42 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:43 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.919s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:21:43 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] Deleted volume successfully. Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6216f2f3-cb6d-402b-8e36-dfb4743fb8a4 tempest-VolumesActionsTest-413695749 None] Lock "cinder-d0a0aee2-a11b-42fd-9953-2c70d69b77db-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Flow 'volume_create_manager' (a2af960d-fed9-47c8-af5d-bb0aa47c0f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6437c8de-f676-458b-a070-5efa5fe8e9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6437c8de-f676-458b-a070-5efa5fe8e9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-487338576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63e005c-cc4c-47e5-8f74-3322d78ee595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa802bb16d24fc2a450202ef42449ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:44Z,use_quota=True,user_id='221e4947d7414584840c2af971fb10c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b241185-18cd-41a2-8e46-18d01aa8e23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b241185-18cd-41a2-8e46-18d01aa8e23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e1eb485-b220-4a68-9b72-eb55d589af7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e1eb485-b220-4a68-9b72-eb55d589af7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b63e005c-cc4c-47e5-8f74-3322d78ee595', 'volume_name': 'volume-b63e005c-cc4c-47e5-8f74-3322d78ee595', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29af3d9e-5422-4f03-959f-df069c2c32c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29af3d9e-5422-4f03-959f-df069c2c32c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9309697-27f9-491f-b852-f1b5e6117d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:43 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Volume b63e005c-cc4c-47e5-8f74-3322d78ee595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b63e005c-cc4c-47e5-8f74-3322d78ee595', 'volume_size': 1} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-487338576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63e005c-cc4c-47e5-8f74-3322d78ee595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa802bb16d24fc2a450202ef42449ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:44Z,use_quota=True,user_id='221e4947d7414584840c2af971fb10c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Creating volume b63e005c-cc4c-47e5-8f74-3322d78ee595 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:21:43 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:21:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b63e005c-cc4c-47e5-8f74-3322d78ee595 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:44 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b63e005c-cc4c-47e5-8f74-3322d78ee595 1073741824 Jun 02 16:21:44 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:45 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b63e005c-cc4c-47e5-8f74-3322d78ee595 1073741824" returned: 0 in 1.375s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b63e005c-cc4c-47e5-8f74-3322d78ee595 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:45 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b63e005c-cc4c-47e5-8f74-3322d78ee595 Jun 02 16:21:45 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:46 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b63e005c-cc4c-47e5-8f74-3322d78ee595" returned: 0 in 0.792s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] <== create_volume: return (2222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:21:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9309697-27f9-491f-b852-f1b5e6117d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63e005c-cc4c-47e5-8f74-3322d78ee595', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5a3e44-2b68-48fb-a6ad-cdaceab8964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:46 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Volume volume-b63e005c-cc4c-47e5-8f74-3322d78ee595 (b63e005c-cc4c-47e5-8f74-3322d78ee595): created successfully Jun 02 16:21:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5a3e44-2b68-48fb-a6ad-cdaceab8964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Flow 'volume_create_manager' (a2af960d-fed9-47c8-af5d-bb0aa47c0f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:46 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-ea4b33eb-a245-48bd-b81e-2f4948e94a4b tempest-VolumesActionsTest-1428956895 None] Created volume successfully. Jun 02 16:21:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] Acquiring lock "cinder-b63e005c-cc4c-47e5-8f74-3322d78ee595-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] Lock "cinder-b63e005c-cc4c-47e5-8f74-3322d78ee595-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] Acquiring lock "cinder-quobyte-b63e005c-cc4c-47e5-8f74-3322d78ee595" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] Lock "cinder-quobyte-b63e005c-cc4c-47e5-8f74-3322d78ee595" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:47 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95f8791-2b9c-4fa5-8ee9-cfd95476113f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b63e005c-cc4c-47e5-8f74-3322d78ee595 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:47 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b63e005c-cc4c-47e5-8f74-3322d78ee595 Jun 02 16:21:47 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:48 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b63e005c-cc4c-47e5-8f74-3322d78ee595" returned: 0 in 1.212s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b63e005c-cc4c-47e5-8f74-3322d78ee595 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:48 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b63e005c-cc4c-47e5-8f74-3322d78ee595 Jun 02 16:21:48 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-eb5f6c8c-2874-460b-8968-8b7d6d452d64 req-5746714c-4651-406e-bcb5-96cf4b63305f tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-eb5f6c8c-2874-460b-8968-8b7d6d452d64 req-5746714c-4651-406e-bcb5-96cf4b63305f tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:49 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-7e76b2c8-625e-48cf-a373-dd4e61d3b61a req-90bfcc79-3e91-46f5-8811-4f53ffa4a371 tempest-TestShelveInstance-6591655 None] Terminate volume connection completed successfully. Jun 02 16:21:49 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-7e76b2c8-625e-48cf-a373-dd4e61d3b61a req-90bfcc79-3e91-46f5-8811-4f53ffa4a371 tempest-TestShelveInstance-6591655 None] Deleting attachment 3d4529b9-0fe1-43e3-af21-095831d8b81c. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:21:49 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4b5dc4-7b77-4e56-9528-dea97718d5d9]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-eb5f6c8c-2874-460b-8968-8b7d6d452d64 req-5746714c-4651-406e-bcb5-96cf4b63305f tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:49 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 Jun 02 16:21:49 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:49 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b63e005c-cc4c-47e5-8f74-3322d78ee595" returned: 0 in 1.101s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:49 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] Lock "cinder-quobyte-b63e005c-cc4c-47e5-8f74-3322d78ee595" released by "delete_volume" :: held 2.403s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:49 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=96,cinder:INSERT=33,cinder:UPDATE=130,cinder:DELETE=12 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:21:50 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:INSERT=38,cinder:UPDATE=103,cinder:SELECT=98,cinder:DELETE=10 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:21:50 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] Created reservations ['a270d0e5-6c91-4f35-bf42-231d32a612d5', '9f05e526-59ab-4909-a1ec-357b45e027de', '79688d48-51d9-4db9-9378-2fe56497f270', 'e6878b01-868c-4ef5-8442-86a0d9a9df53'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:21:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:50 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:21:50 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:50 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-eb5f6c8c-2874-460b-8968-8b7d6d452d64 req-5746714c-4651-406e-bcb5-96cf4b63305f tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454" returned: 0 in 0.972s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-eb5f6c8c-2874-460b-8968-8b7d6d452d64 req-5746714c-4651-406e-bcb5-96cf4b63305f tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:50 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 Jun 02 16:21:50 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:50 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.705s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:50 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:21:50 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] Deleted volume successfully. Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9853b223-c692-4f1d-8af3-accdac90cffe tempest-VolumesActionsTest-413695749 None] Lock "cinder-b63e005c-cc4c-47e5-8f74-3322d78ee595-delete_volume" released by "delete_volume" :: held 3.513s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:51 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-eb5f6c8c-2874-460b-8968-8b7d6d452d64 req-5746714c-4651-406e-bcb5-96cf4b63305f tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454" returned: 1 in 0.843s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-eb5f6c8c-2874-460b-8968-8b7d6d452d64 req-5746714c-4651-406e-bcb5-96cf4b63305f tempest-TestInstancesWithCinderVolumes-1552097342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-eb5f6c8c-2874-460b-8968-8b7d6d452d64 req-5746714c-4651-406e-bcb5-96cf4b63305f tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.873s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-eb5f6c8c-2874-460b-8968-8b7d6d452d64 req-5746714c-4651-406e-bcb5-96cf4b63305f tempest-TestInstancesWithCinderVolumes-1552097342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-3303e87e-635e-44cf-907f-06df6f2a7454', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca43b52c-3d0f-43f1-ac63-fdd7c2f47406', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:21:51 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-eb5f6c8c-2874-460b-8968-8b7d6d452d64 req-5746714c-4651-406e-bcb5-96cf4b63305f tempest-TestInstancesWithCinderVolumes-1552097342 None] attachment_update completed successfully. Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Flow 'volume_create_manager' (be38500b-3201-41f9-86c7-1881869e5200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd139a0e-d001-46e4-8063-f1f04b143ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd139a0e-d001-46e4-8063-f1f04b143ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-834776554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f74e9e-98da-454f-89a7-d92672abd2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6514623ffb34c65bc76dd5b2ef2e573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:52Z,use_quota=True,user_id='3a1f5a83513745ad80f42e913f493193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9beb3337-e1c7-44b4-9f7c-534ec1f9e626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9beb3337-e1c7-44b4-9f7c-534ec1f9e626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aebc513-de01-4d54-b2c3-1c260c22a896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aebc513-de01-4d54-b2c3-1c260c22a896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4f74e9e-98da-454f-89a7-d92672abd2c1', 'volume_name': 'volume-e4f74e9e-98da-454f-89a7-d92672abd2c1', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb458df2-14a0-43df-95ba-55eb929f4849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb458df2-14a0-43df-95ba-55eb929f4849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7cac6c0-8b09-40b8-a66e-f04f93dfb375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:51 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Volume e4f74e9e-98da-454f-89a7-d92672abd2c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4f74e9e-98da-454f-89a7-d92672abd2c1', 'volume_size': 1} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-834776554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f74e9e-98da-454f-89a7-d92672abd2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6514623ffb34c65bc76dd5b2ef2e573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:52Z,use_quota=True,user_id='3a1f5a83513745ad80f42e913f493193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Creating volume e4f74e9e-98da-454f-89a7-d92672abd2c1 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:21:51 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:21:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4f74e9e-98da-454f-89a7-d92672abd2c1 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:52 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4f74e9e-98da-454f-89a7-d92672abd2c1 1073741824 Jun 02 16:21:52 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:52 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:21:52 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Flow 'volume_create_manager' (5248b192-52d0-468d-8859-c5d4a557111b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:52 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db43259f-791e-42de-b6cf-4d374cde1ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:52 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db43259f-791e-42de-b6cf-4d374cde1ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-682799667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8e7da4-a982-43b4-8f95-68f35ceebe4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa802bb16d24fc2a450202ef42449ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:52Z,use_quota=True,user_id='221e4947d7414584840c2af971fb10c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:52 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7648776-3055-4c72-a023-c76e16fdb00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:52 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7648776-3055-4c72-a023-c76e16fdb00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:52 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd66554-f00c-4a6e-8f9d-46b595573b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:52 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd66554-f00c-4a6e-8f9d-46b595573b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a8e7da4-a982-43b4-8f95-68f35ceebe4a', 'volume_name': 'volume-3a8e7da4-a982-43b4-8f95-68f35ceebe4a', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:52 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee95e8b-3a19-444d-b3d1-dbc3e65af928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:52 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee95e8b-3a19-444d-b3d1-dbc3e65af928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:52 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38047df1-ddc3-4e2c-b8c4-a11e5a5eb6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:52 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Volume 3a8e7da4-a982-43b4-8f95-68f35ceebe4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a8e7da4-a982-43b4-8f95-68f35ceebe4a', 'volume_size': 1} Jun 02 16:21:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:53 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4f74e9e-98da-454f-89a7-d92672abd2c1 1073741824" returned: 0 in 1.055s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4f74e9e-98da-454f-89a7-d92672abd2c1 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:53 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4f74e9e-98da-454f-89a7-d92672abd2c1 Jun 02 16:21:53 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:53 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4f74e9e-98da-454f-89a7-d92672abd2c1" returned: 0 in 0.655s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.139s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-682799667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8e7da4-a982-43b4-8f95-68f35ceebe4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa802bb16d24fc2a450202ef42449ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:21:52Z,use_quota=True,user_id='221e4947d7414584840c2af971fb10c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Creating volume 3a8e7da4-a982-43b4-8f95-68f35ceebe4a {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:21:53 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a8e7da4-a982-43b4-8f95-68f35ceebe4a 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7cac6c0-8b09-40b8-a66e-f04f93dfb375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4f74e9e-98da-454f-89a7-d92672abd2c1', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:53 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a8e7da4-a982-43b4-8f95-68f35ceebe4a 1073741824 Jun 02 16:21:53 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9355e495-ba20-45e4-8f40-80bceb96a5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:53 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Volume volume-e4f74e9e-98da-454f-89a7-d92672abd2c1 (e4f74e9e-98da-454f-89a7-d92672abd2c1): created successfully Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9355e495-ba20-45e4-8f40-80bceb96a5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Flow 'volume_create_manager' (be38500b-3201-41f9-86c7-1881869e5200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:53 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-32d08815-dd0c-469b-96ff-edbf705768d6 tempest-VolumesTransfersV357Test-1837078890 None] Created volume successfully. Jun 02 16:21:54 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a8e7da4-a982-43b4-8f95-68f35ceebe4a 1073741824" returned: 0 in 0.860s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a8e7da4-a982-43b4-8f95-68f35ceebe4a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:54 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a8e7da4-a982-43b4-8f95-68f35ceebe4a Jun 02 16:21:54 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-cb819ee5-38db-497e-82bc-49ba227fe1df req-32546abe-c819-4090-8fff-7b257a6b71c4 tempest-TestShelveInstance-6591655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:55 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a8e7da4-a982-43b4-8f95-68f35ceebe4a" returned: 0 in 0.671s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:55 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:21:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-cb819ee5-38db-497e-82bc-49ba227fe1df req-32546abe-c819-4090-8fff-7b257a6b71c4 tempest-TestShelveInstance-6591655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.219s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38047df1-ddc3-4e2c-b8c4-a11e5a5eb6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a8e7da4-a982-43b4-8f95-68f35ceebe4a', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4023bd6f-61dc-448b-9ba5-f6a08d1356c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:21:55 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Volume volume-3a8e7da4-a982-43b4-8f95-68f35ceebe4a (3a8e7da4-a982-43b4-8f95-68f35ceebe4a): created successfully Jun 02 16:21:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4023bd6f-61dc-448b-9ba5-f6a08d1356c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:21:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Flow 'volume_create_manager' (5248b192-52d0-468d-8859-c5d4a557111b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:21:55 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba13c80-0d18-434c-bda9-fb1cb9d4f69b]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-cb819ee5-38db-497e-82bc-49ba227fe1df req-32546abe-c819-4090-8fff-7b257a6b71c4 tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:55 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-73a35317-ae93-4d32-b1d7-8c89ad789698 tempest-VolumesActionsTest-1428956895 None] Created volume successfully. Jun 02 16:21:55 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b Jun 02 16:21:55 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:55 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-80e5fbd0-28a7-41e1-a22e-9d64caa44e07 tempest-VolumesTransfersV357Test-165355687 None] Transfer volume completed successfully. Jun 02 16:21:56 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-cb819ee5-38db-497e-82bc-49ba227fe1df req-32546abe-c819-4090-8fff-7b257a6b71c4 tempest-TestShelveInstance-6591655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b" returned: 0 in 0.717s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-cb819ee5-38db-497e-82bc-49ba227fe1df req-32546abe-c819-4090-8fff-7b257a6b71c4 tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:56 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b Jun 02 16:21:56 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:56 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] Acquiring lock "cinder-e4f74e9e-98da-454f-89a7-d92672abd2c1-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:56 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] Lock "cinder-e4f74e9e-98da-454f-89a7-d92672abd2c1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:56 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] Acquiring lock "cinder-quobyte-e4f74e9e-98da-454f-89a7-d92672abd2c1" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:56 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] Lock "cinder-quobyte-e4f74e9e-98da-454f-89a7-d92672abd2c1" acquired by "delete_volume" :: waited 0.025s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:56 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[032b493a-04be-4f80-85a3-0814a40678fa]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4f74e9e-98da-454f-89a7-d92672abd2c1 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:56 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4f74e9e-98da-454f-89a7-d92672abd2c1 Jun 02 16:21:56 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:57 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-cb819ee5-38db-497e-82bc-49ba227fe1df req-32546abe-c819-4090-8fff-7b257a6b71c4 tempest-TestShelveInstance-6591655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b" returned: 1 in 1.167s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-cb819ee5-38db-497e-82bc-49ba227fe1df req-32546abe-c819-4090-8fff-7b257a6b71c4 tempest-TestShelveInstance-6591655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:21:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-cb819ee5-38db-497e-82bc-49ba227fe1df req-32546abe-c819-4090-8fff-7b257a6b71c4 tempest-TestShelveInstance-6591655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.946s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-cb819ee5-38db-497e-82bc-49ba227fe1df req-32546abe-c819-4090-8fff-7b257a6b71c4 tempest-TestShelveInstance-6591655 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67c32940-b2cb-42b4-9d3f-e9f2218852b1', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:21:57 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-cb819ee5-38db-497e-82bc-49ba227fe1df req-32546abe-c819-4090-8fff-7b257a6b71c4 tempest-TestShelveInstance-6591655 None] attachment_update completed successfully. Jun 02 16:21:57 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] Acquiring lock "cinder-3a8e7da4-a982-43b4-8f95-68f35ceebe4a-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:57 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] Lock "cinder-3a8e7da4-a982-43b4-8f95-68f35ceebe4a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:58 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] Acquiring lock "cinder-quobyte-3a8e7da4-a982-43b4-8f95-68f35ceebe4a" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:21:58 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] Lock "cinder-quobyte-3a8e7da4-a982-43b4-8f95-68f35ceebe4a" acquired by "delete_volume" :: waited 0.029s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:21:58 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a905fce-f5d8-4fa4-9554-4a75bb11f864]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:21:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a8e7da4-a982-43b4-8f95-68f35ceebe4a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:58 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4f74e9e-98da-454f-89a7-d92672abd2c1" returned: 0 in 1.392s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4f74e9e-98da-454f-89a7-d92672abd2c1 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:58 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4f74e9e-98da-454f-89a7-d92672abd2c1 Jun 02 16:21:58 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:58 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a8e7da4-a982-43b4-8f95-68f35ceebe4a Jun 02 16:21:58 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:58 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a8e7da4-a982-43b4-8f95-68f35ceebe4a" returned: 0 in 0.922s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a8e7da4-a982-43b4-8f95-68f35ceebe4a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:59 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a8e7da4-a982-43b4-8f95-68f35ceebe4a Jun 02 16:21:59 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:59 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4f74e9e-98da-454f-89a7-d92672abd2c1" returned: 0 in 0.892s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] Lock "cinder-quobyte-e4f74e9e-98da-454f-89a7-d92672abd2c1" released by "delete_volume" :: held 2.375s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] Created reservations ['38c1a3d9-67e8-4912-b956-6619d1472d51', '8a5b4736-7899-4b5e-9b88-1b19bfc3ecf6', '232d792c-6588-4cec-94fe-2ca306dffee8', '2e65209a-94ff-43eb-8741-7e5a17eae4d4'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:59 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:21:59 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:21:59 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3a8e7da4-a982-43b4-8f95-68f35ceebe4a" returned: 0 in 0.739s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] Lock "cinder-quobyte-3a8e7da4-a982-43b4-8f95-68f35ceebe4a" released by "delete_volume" :: held 1.717s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] Created reservations ['7836edb8-ab98-4aef-962d-feee6ea21427', '6783a376-0ffc-464a-8cbe-89e57cb62a77', '99c1ecde-dc1e-4cfa-9336-4e475ca6064b', '828515b5-3ace-4055-9e68-79ce53a9a6d4'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:21:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:21:59 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:21:59 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:22:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:00 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:22:00 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:00 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.242s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:00 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:22:00 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] Deleted volume successfully. Jun 02 16:22:00 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-251a7597-b064-4ea8-ae6e-5564278858cb tempest-VolumesTransfersV357Test-80748272 None] Lock "cinder-e4f74e9e-98da-454f-89a7-d92672abd2c1-delete_volume" released by "delete_volume" :: held 3.939s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:01 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.157s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:22:01 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] Deleted volume successfully. Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5484fcbe-8d33-45a8-9b1c-9dd7e9017a2d tempest-VolumesActionsTest-1428956895 None] Lock "cinder-3a8e7da4-a982-43b4-8f95-68f35ceebe4a-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Flow 'volume_create_manager' (8e092838-32ba-4ebe-ba94-2e614d9089ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d2ede0-c3d3-4201-833b-bb8f85dd36d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d2ede0-c3d3-4201-833b-bb8f85dd36d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1904209471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c9b496-508c-4d6f-a10a-fb0cb7e8edda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6514623ffb34c65bc76dd5b2ef2e573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:02Z,use_quota=True,user_id='3a1f5a83513745ad80f42e913f493193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f758b851-c391-4438-b2ae-0e521f723b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:01 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f758b851-c391-4438-b2ae-0e521f723b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e991338a-4684-462b-9cec-7edb22b8e2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e991338a-4684-462b-9cec-7edb22b8e2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c9b496-508c-4d6f-a10a-fb0cb7e8edda', 'volume_name': 'volume-34c9b496-508c-4d6f-a10a-fb0cb7e8edda', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a33c80d-0ae6-4e43-a461-60c8cfa0af73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a33c80d-0ae6-4e43-a461-60c8cfa0af73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c06c45e-08e7-42c6-96a8-4e05e462361f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:01 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Volume 34c9b496-508c-4d6f-a10a-fb0cb7e8edda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c9b496-508c-4d6f-a10a-fb0cb7e8edda', 'volume_size': 1} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1904209471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c9b496-508c-4d6f-a10a-fb0cb7e8edda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6514623ffb34c65bc76dd5b2ef2e573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:02Z,use_quota=True,user_id='3a1f5a83513745ad80f42e913f493193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Creating volume 34c9b496-508c-4d6f-a10a-fb0cb7e8edda {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:22:01 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34c9b496-508c-4d6f-a10a-fb0cb7e8edda 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.715s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:01 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:22:01 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34c9b496-508c-4d6f-a10a-fb0cb7e8edda 1073741824 Jun 02 16:22:01 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:02 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34c9b496-508c-4d6f-a10a-fb0cb7e8edda 1073741824" returned: 0 in 1.143s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34c9b496-508c-4d6f-a10a-fb0cb7e8edda {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:03 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34c9b496-508c-4d6f-a10a-fb0cb7e8edda Jun 02 16:22:03 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:03 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34c9b496-508c-4d6f-a10a-fb0cb7e8edda" returned: 0 in 0.923s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] <== create_volume: return (2162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:22:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.165s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c06c45e-08e7-42c6-96a8-4e05e462361f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c9b496-508c-4d6f-a10a-fb0cb7e8edda', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52989706-3ebd-44f9-83d6-696c5a3717f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:04 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Volume volume-34c9b496-508c-4d6f-a10a-fb0cb7e8edda (34c9b496-508c-4d6f-a10a-fb0cb7e8edda): created successfully Jun 02 16:22:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52989706-3ebd-44f9-83d6-696c5a3717f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Flow 'volume_create_manager' (8e092838-32ba-4ebe-ba94-2e614d9089ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:04 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0a23c4ae-b94c-4189-9184-62bb83b48040 tempest-VolumesTransfersV357Test-1837078890 None] Created volume successfully. Jun 02 16:22:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] Acquiring lock "cinder-34c9b496-508c-4d6f-a10a-fb0cb7e8edda-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] Lock "cinder-34c9b496-508c-4d6f-a10a-fb0cb7e8edda-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] Acquiring lock "cinder-quobyte-34c9b496-508c-4d6f-a10a-fb0cb7e8edda" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] Lock "cinder-quobyte-34c9b496-508c-4d6f-a10a-fb0cb7e8edda" acquired by "delete_volume" :: waited 0.024s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:05 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa93cf28-27ed-46cd-abc9-ae8e0869af69]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:22:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34c9b496-508c-4d6f-a10a-fb0cb7e8edda {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:05 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34c9b496-508c-4d6f-a10a-fb0cb7e8edda Jun 02 16:22:05 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:06 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34c9b496-508c-4d6f-a10a-fb0cb7e8edda" returned: 0 in 1.099s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34c9b496-508c-4d6f-a10a-fb0cb7e8edda {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:06 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34c9b496-508c-4d6f-a10a-fb0cb7e8edda Jun 02 16:22:06 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:07 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34c9b496-508c-4d6f-a10a-fb0cb7e8edda" returned: 0 in 0.849s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] Lock "cinder-quobyte-34c9b496-508c-4d6f-a10a-fb0cb7e8edda" released by "delete_volume" :: held 2.036s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:07 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] Created reservations ['c00bc28e-8566-4620-92e0-7cce373a8d9d', 'cbd6e7e8-3ebd-40bb-b62e-c563fe33484b', 'd475f8c1-e1da-40b7-8cbe-2c41e8bb94b0', '15aa3c3a-ba4a-4c00-b3ec-dbd8e64bc744'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:22:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:08 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:22:08 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:08 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.897s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:08 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:22:08 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] Deleted volume successfully. Jun 02 16:22:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-879fcf08-5871-4d36-a4f7-bcac28bf092b tempest-VolumesTransfersV357Test-80748272 None] Lock "cinder-34c9b496-508c-4d6f-a10a-fb0cb7e8edda-delete_volume" released by "delete_volume" :: held 3.291s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:17 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:INSERT=10,cinder:UPDATE=45,cinder:SELECT=37,cinder:DELETE=3 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Flow 'volume_create_manager' (8062bd32-3a13-49f7-9522-8d82d6e04c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2dc8c7c-a868-4f31-a350-38de9dc7190d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2dc8c7c-a868-4f31-a350-38de9dc7190d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-75739875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59a883ca-f482-4603-b9e1-6e02621f278e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e19d26f13674d6bb7d962c63636f466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:19Z,use_quota=True,user_id='42f78257aa2340888f0a95a18e860ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61453d5e-b0e2-4263-a533-6a9082cc8d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61453d5e-b0e2-4263-a533-6a9082cc8d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14117d1-e8ac-48c1-b320-26fd9534e3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14117d1-e8ac-48c1-b320-26fd9534e3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59a883ca-f482-4603-b9e1-6e02621f278e', 'volume_name': 'volume-59a883ca-f482-4603-b9e1-6e02621f278e', 'volume_size': 2}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7614b840-40e2-4d05-a040-eed86058c68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7614b840-40e2-4d05-a040-eed86058c68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3719cea8-e9ca-489e-8f14-8c290df81100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:18 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Volume 59a883ca-f482-4603-b9e1-6e02621f278e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59a883ca-f482-4603-b9e1-6e02621f278e', 'volume_size': 2} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-75739875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59a883ca-f482-4603-b9e1-6e02621f278e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e19d26f13674d6bb7d962c63636f466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:19Z,use_quota=True,user_id='42f78257aa2340888f0a95a18e860ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Creating volume 59a883ca-f482-4603-b9e1-6e02621f278e {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:22:18 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:22:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-59a883ca-f482-4603-b9e1-6e02621f278e 2147483648 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:19 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-59a883ca-f482-4603-b9e1-6e02621f278e 2147483648 Jun 02 16:22:19 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:20 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-59a883ca-f482-4603-b9e1-6e02621f278e 2147483648" returned: 0 in 1.191s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-59a883ca-f482-4603-b9e1-6e02621f278e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:20 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-59a883ca-f482-4603-b9e1-6e02621f278e Jun 02 16:22:20 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:20 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-59a883ca-f482-4603-b9e1-6e02621f278e" returned: 0 in 0.695s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:22:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3719cea8-e9ca-489e-8f14-8c290df81100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59a883ca-f482-4603-b9e1-6e02621f278e', 'volume_size': 2}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (470eb7a1-187b-4bbd-8036-037e068115a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:20 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Volume volume-59a883ca-f482-4603-b9e1-6e02621f278e (59a883ca-f482-4603-b9e1-6e02621f278e): created successfully Jun 02 16:22:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (470eb7a1-187b-4bbd-8036-037e068115a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Flow 'volume_create_manager' (8062bd32-3a13-49f7-9522-8d82d6e04c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:20 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-cda9fb63-a6ac-4e5a-993c-9ed25af25cef tempest-VolumesCloneNegativeTest-1024804337 None] Created volume successfully. Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Flow 'volume_create_manager' (aa942377-68b3-45a0-9500-2ee0e4172e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003927e0-e857-450e-a382-0c57bf9186a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003927e0-e857-450e-a382-0c57bf9186a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1108979830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c1635e-3cff-4dbd-96c4-0ac5652f941f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='20e5ea32e16c4becb52bd5a11e2e345c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:22Z,use_quota=True,user_id='55e7ce38c8594727b9e207ef2cef0600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37ef376-b308-43ec-a539-057e10e6c361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37ef376-b308-43ec-a539-057e10e6c361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdc4c9d-8eba-4f9f-997f-849ff10aa278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdc4c9d-8eba-4f9f-997f-849ff10aa278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1c1635e-3cff-4dbd-96c4-0ac5652f941f', 'volume_name': 'volume-e1c1635e-3cff-4dbd-96c4-0ac5652f941f', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5198b6-a060-4b6c-b2da-c0f983352710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5198b6-a060-4b6c-b2da-c0f983352710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a304fe54-426f-40fe-9ca5-d23bb22eaab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:21 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Volume e1c1635e-3cff-4dbd-96c4-0ac5652f941f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1c1635e-3cff-4dbd-96c4-0ac5652f941f', 'volume_size': 1} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1108979830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c1635e-3cff-4dbd-96c4-0ac5652f941f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='20e5ea32e16c4becb52bd5a11e2e345c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:22Z,use_quota=True,user_id='55e7ce38c8594727b9e207ef2cef0600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Creating volume e1c1635e-3cff-4dbd-96c4-0ac5652f941f {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:22:21 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:22:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e1c1635e-3cff-4dbd-96c4-0ac5652f941f 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:21 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e1c1635e-3cff-4dbd-96c4-0ac5652f941f 1073741824 Jun 02 16:22:21 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] Acquiring lock "cinder-59a883ca-f482-4603-b9e1-6e02621f278e-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] Lock "cinder-59a883ca-f482-4603-b9e1-6e02621f278e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] Acquiring lock "cinder-quobyte-59a883ca-f482-4603-b9e1-6e02621f278e" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] Lock "cinder-quobyte-59a883ca-f482-4603-b9e1-6e02621f278e" acquired by "delete_volume" :: waited 0.017s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:22 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37053c8-d526-46e7-b939-7bb499353288]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:22:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-59a883ca-f482-4603-b9e1-6e02621f278e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:22 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-59a883ca-f482-4603-b9e1-6e02621f278e Jun 02 16:22:22 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:22 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e1c1635e-3cff-4dbd-96c4-0ac5652f941f 1073741824" returned: 0 in 0.913s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e1c1635e-3cff-4dbd-96c4-0ac5652f941f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:22 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e1c1635e-3cff-4dbd-96c4-0ac5652f941f Jun 02 16:22:22 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:23 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-59a883ca-f482-4603-b9e1-6e02621f278e" returned: 0 in 0.780s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-59a883ca-f482-4603-b9e1-6e02621f278e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:23 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-59a883ca-f482-4603-b9e1-6e02621f278e Jun 02 16:22:23 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:23 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e1c1635e-3cff-4dbd-96c4-0ac5652f941f" returned: 0 in 0.623s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a304fe54-426f-40fe-9ca5-d23bb22eaab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c1635e-3cff-4dbd-96c4-0ac5652f941f', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b995a6-e37f-4843-b660-3fbfc4e293af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:23 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Volume volume-e1c1635e-3cff-4dbd-96c4-0ac5652f941f (e1c1635e-3cff-4dbd-96c4-0ac5652f941f): created successfully Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b995a6-e37f-4843-b660-3fbfc4e293af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Flow 'volume_create_manager' (aa942377-68b3-45a0-9500-2ee0e4172e46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:23 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-e23a50a5-3004-46af-89ef-1b47cdeb1b97 tempest-VolumesListTestJSON-803216603 None] Created volume successfully. Jun 02 16:22:23 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-59a883ca-f482-4603-b9e1-6e02621f278e" returned: 0 in 0.653s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] Lock "cinder-quobyte-59a883ca-f482-4603-b9e1-6e02621f278e" released by "delete_volume" :: held 1.496s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] Created reservations ['da6cf594-97f7-4a45-aab6-2f4866781d1a', '89997146-dabd-4561-8ec8-9bb2f137ab1e', 'd3301dd6-ab61-4766-8927-42931b6f0787', '8f76176c-60af-4ff2-b955-0b0d51493fae'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:24 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:22:24 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Flow 'volume_create_manager' (24b23fe5-12a9-4d95-a86b-e98247936a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc1fbde-e7ed-49ce-8ce7-17dcbe565a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc1fbde-e7ed-49ce-8ce7-17dcbe565a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1876549751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f08ea5d-aecd-474c-ab70-bec764bbc257,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='20e5ea32e16c4becb52bd5a11e2e345c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:24Z,use_quota=True,user_id='55e7ce38c8594727b9e207ef2cef0600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb0f101-ae1c-4cf4-9faf-431080dfe40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb0f101-ae1c-4cf4-9faf-431080dfe40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67b2b6c-1fd0-44b8-b6c8-259dbf92ff06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67b2b6c-1fd0-44b8-b6c8-259dbf92ff06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f08ea5d-aecd-474c-ab70-bec764bbc257', 'volume_name': 'volume-7f08ea5d-aecd-474c-ab70-bec764bbc257', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4e62f6-8064-4450-9cf1-8d3e8159f6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4e62f6-8064-4450-9cf1-8d3e8159f6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce8567f-190d-40c1-97c4-0404d40a3c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:24 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Volume 7f08ea5d-aecd-474c-ab70-bec764bbc257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f08ea5d-aecd-474c-ab70-bec764bbc257', 'volume_size': 1} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1876549751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f08ea5d-aecd-474c-ab70-bec764bbc257,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='20e5ea32e16c4becb52bd5a11e2e345c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:24Z,use_quota=True,user_id='55e7ce38c8594727b9e207ef2cef0600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Creating volume 7f08ea5d-aecd-474c-ab70-bec764bbc257 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:22:24 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f08ea5d-aecd-474c-ab70-bec764bbc257 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:24 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f08ea5d-aecd-474c-ab70-bec764bbc257 1073741824 Jun 02 16:22:24 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:24 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.749s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:22:24 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] Deleted volume successfully. Jun 02 16:22:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-364844e1-9c96-4a7b-8ae6-756e9ca01d1c tempest-VolumesCloneNegativeTest-1024804337 None] Lock "cinder-59a883ca-f482-4603-b9e1-6e02621f278e-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:25 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f08ea5d-aecd-474c-ab70-bec764bbc257 1073741824" returned: 0 in 1.098s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f08ea5d-aecd-474c-ab70-bec764bbc257 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:25 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f08ea5d-aecd-474c-ab70-bec764bbc257 Jun 02 16:22:25 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:26 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f08ea5d-aecd-474c-ab70-bec764bbc257" returned: 0 in 0.922s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:26 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:22:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:26 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce8567f-190d-40c1-97c4-0404d40a3c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f08ea5d-aecd-474c-ab70-bec764bbc257', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:26 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21543fa9-8460-4bff-b9c8-2903ce1b9434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:26 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Volume volume-7f08ea5d-aecd-474c-ab70-bec764bbc257 (7f08ea5d-aecd-474c-ab70-bec764bbc257): created successfully Jun 02 16:22:26 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21543fa9-8460-4bff-b9c8-2903ce1b9434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:26 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Flow 'volume_create_manager' (24b23fe5-12a9-4d95-a86b-e98247936a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:26 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-5854bc9d-f507-4aae-869d-7c646b8057ba tempest-VolumesListTestJSON-803216603 None] Created volume successfully. Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Flow 'volume_create_manager' (2ebe020b-8147-4df6-95ca-6993d0870c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455787c0-dabd-44f3-98e5-59c7d23a7b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455787c0-dabd-44f3-98e5-59c7d23a7b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1071857647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d530a368-693f-4d41-9856-16e0aee7f01e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='20e5ea32e16c4becb52bd5a11e2e345c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:28Z,use_quota=True,user_id='55e7ce38c8594727b9e207ef2cef0600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184cad45-257a-439c-9780-702decbec426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184cad45-257a-439c-9780-702decbec426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1730a736-353f-4c52-a9b2-c960c027d54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1730a736-353f-4c52-a9b2-c960c027d54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd530a368-693f-4d41-9856-16e0aee7f01e', 'volume_name': 'volume-d530a368-693f-4d41-9856-16e0aee7f01e', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eafe0cc3-d449-4bab-96b5-2324756b437b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eafe0cc3-d449-4bab-96b5-2324756b437b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f42209-5465-4073-a70d-416b35812b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:28 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Volume d530a368-693f-4d41-9856-16e0aee7f01e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d530a368-693f-4d41-9856-16e0aee7f01e', 'volume_size': 1} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1071857647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d530a368-693f-4d41-9856-16e0aee7f01e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='20e5ea32e16c4becb52bd5a11e2e345c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:28Z,use_quota=True,user_id='55e7ce38c8594727b9e207ef2cef0600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Creating volume d530a368-693f-4d41-9856-16e0aee7f01e {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:22:28 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d530a368-693f-4d41-9856-16e0aee7f01e 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:28 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d530a368-693f-4d41-9856-16e0aee7f01e 1073741824 Jun 02 16:22:28 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Flow 'volume_create_manager' (32f60fa2-55d7-477e-8f1c-eb5515f7b372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f7ff74-2967-4dee-b853-e30b4ab3afcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f7ff74-2967-4dee-b853-e30b4ab3afcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-576018655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34153052-5a44-4fbc-9f99-5f83d5e43940,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='427c72f1a9d04f53b67156bfa4d89e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:29Z,use_quota=True,user_id='ce748a22f5c84d51860c481c89a4da21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385a6a64-af8a-497f-95b1-001ba0b2ced8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385a6a64-af8a-497f-95b1-001ba0b2ced8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f85314b-1a9b-454e-acd2-eac911ca31a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f85314b-1a9b-454e-acd2-eac911ca31a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34153052-5a44-4fbc-9f99-5f83d5e43940', 'volume_name': 'volume-34153052-5a44-4fbc-9f99-5f83d5e43940', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00e031b-8912-410e-ab7f-b72a1b00971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00e031b-8912-410e-ab7f-b72a1b00971a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793778c9-3fc8-4233-85b5-59745130b925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:28 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Volume 34153052-5a44-4fbc-9f99-5f83d5e43940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34153052-5a44-4fbc-9f99-5f83d5e43940', 'volume_size': 1} Jun 02 16:22:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:29 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d530a368-693f-4d41-9856-16e0aee7f01e 1073741824" returned: 0 in 0.807s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d530a368-693f-4d41-9856-16e0aee7f01e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:29 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d530a368-693f-4d41-9856-16e0aee7f01e Jun 02 16:22:29 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:30 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d530a368-693f-4d41-9856-16e0aee7f01e" returned: 0 in 0.592s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:30 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:22:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.161s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:30 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-576018655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34153052-5a44-4fbc-9f99-5f83d5e43940,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='427c72f1a9d04f53b67156bfa4d89e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:29Z,use_quota=True,user_id='ce748a22f5c84d51860c481c89a4da21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:22:30 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Creating volume 34153052-5a44-4fbc-9f99-5f83d5e43940 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:22:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:30 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:30 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:30 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:22:30 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:22:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34153052-5a44-4fbc-9f99-5f83d5e43940 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:30 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34153052-5a44-4fbc-9f99-5f83d5e43940 1073741824 Jun 02 16:22:30 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f42209-5465-4073-a70d-416b35812b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d530a368-693f-4d41-9856-16e0aee7f01e', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d70807-a8f4-4a32-aaa7-397f2ee5677b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:30 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Volume volume-d530a368-693f-4d41-9856-16e0aee7f01e (d530a368-693f-4d41-9856-16e0aee7f01e): created successfully Jun 02 16:22:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d70807-a8f4-4a32-aaa7-397f2ee5677b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Flow 'volume_create_manager' (2ebe020b-8147-4df6-95ca-6993d0870c9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:30 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-5b57154d-9ef5-46a9-9379-68c046528c79 tempest-VolumesListTestJSON-803216603 None] Created volume successfully. Jun 02 16:22:31 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34153052-5a44-4fbc-9f99-5f83d5e43940 1073741824" returned: 0 in 0.922s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34153052-5a44-4fbc-9f99-5f83d5e43940 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:31 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34153052-5a44-4fbc-9f99-5f83d5e43940 Jun 02 16:22:31 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:31 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34153052-5a44-4fbc-9f99-5f83d5e43940" returned: 0 in 0.685s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:22:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793778c9-3fc8-4233-85b5-59745130b925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34153052-5a44-4fbc-9f99-5f83d5e43940', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be195ea7-eb3e-4b10-95c8-c87db981f7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:31 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Volume volume-34153052-5a44-4fbc-9f99-5f83d5e43940 (34153052-5a44-4fbc-9f99-5f83d5e43940): created successfully Jun 02 16:22:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be195ea7-eb3e-4b10-95c8-c87db981f7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Flow 'volume_create_manager' (32f60fa2-55d7-477e-8f1c-eb5515f7b372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:31 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-c0fecd79-80bf-4168-b574-9ec403192d89 tempest-VolumesGetTest-337646348 None] Created volume successfully. Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Flow 'volume_create_manager' (6a4207fc-af8f-40b8-afd7-075e770cce41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c4d9a8-d645-442d-93f4-fd20e960b404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c4d9a8-d645-442d-93f4-fd20e960b404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1463418433',display_name='tempest-VolumesGetTest-Volume-160878484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2652a021-1913-47aa-8cc0-345906ab66e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427c72f1a9d04f53b67156bfa4d89e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:33Z,use_quota=True,user_id='ce748a22f5c84d51860c481c89a4da21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0232ae31-864d-49b2-95b3-a54a959eb4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0232ae31-864d-49b2-95b3-a54a959eb4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28c5e51-98f5-4f4c-af39-9ae4c0411336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28c5e51-98f5-4f4c-af39-9ae4c0411336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2652a021-1913-47aa-8cc0-345906ab66e1', 'volume_name': 'volume-2652a021-1913-47aa-8cc0-345906ab66e1', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba276d5d-a285-4894-9104-0eca371525c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba276d5d-a285-4894-9104-0eca371525c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6393466e-613a-435b-930c-c670a821ccee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:32 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Volume 2652a021-1913-47aa-8cc0-345906ab66e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2652a021-1913-47aa-8cc0-345906ab66e1', 'volume_size': 1} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1463418433',display_name='tempest-VolumesGetTest-Volume-160878484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2652a021-1913-47aa-8cc0-345906ab66e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427c72f1a9d04f53b67156bfa4d89e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:33Z,use_quota=True,user_id='ce748a22f5c84d51860c481c89a4da21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Creating volume 2652a021-1913-47aa-8cc0-345906ab66e1 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:22:32 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:22:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2652a021-1913-47aa-8cc0-345906ab66e1 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:32 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2652a021-1913-47aa-8cc0-345906ab66e1 1073741824 Jun 02 16:22:32 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] Acquiring lock "cinder-d530a368-693f-4d41-9856-16e0aee7f01e-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] Lock "cinder-d530a368-693f-4d41-9856-16e0aee7f01e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] Acquiring lock "cinder-quobyte-d530a368-693f-4d41-9856-16e0aee7f01e" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] Lock "cinder-quobyte-d530a368-693f-4d41-9856-16e0aee7f01e" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:33 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2e063a-0dec-4c20-af2a-7585921acf27]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:22:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d530a368-693f-4d41-9856-16e0aee7f01e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:33 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d530a368-693f-4d41-9856-16e0aee7f01e Jun 02 16:22:33 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:33 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2652a021-1913-47aa-8cc0-345906ab66e1 1073741824" returned: 0 in 0.905s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2652a021-1913-47aa-8cc0-345906ab66e1 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:33 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2652a021-1913-47aa-8cc0-345906ab66e1 Jun 02 16:22:33 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:33 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d530a368-693f-4d41-9856-16e0aee7f01e" returned: 0 in 0.757s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d530a368-693f-4d41-9856-16e0aee7f01e {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:33 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d530a368-693f-4d41-9856-16e0aee7f01e Jun 02 16:22:33 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:34 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2652a021-1913-47aa-8cc0-345906ab66e1" returned: 0 in 0.661s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6393466e-613a-435b-930c-c670a821ccee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2652a021-1913-47aa-8cc0-345906ab66e1', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d30f46-2c23-4a7e-b802-c81e1f990971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:34 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Volume volume-2652a021-1913-47aa-8cc0-345906ab66e1 (2652a021-1913-47aa-8cc0-345906ab66e1): created successfully Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d30f46-2c23-4a7e-b802-c81e1f990971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Flow 'volume_create_manager' (6a4207fc-af8f-40b8-afd7-075e770cce41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:34 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-51bfbf8b-3a9a-42a2-9a4a-633c1cd96309 tempest-VolumesGetTest-337646348 None] Created volume successfully. Jun 02 16:22:34 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d530a368-693f-4d41-9856-16e0aee7f01e" returned: 0 in 0.647s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] Lock "cinder-quobyte-d530a368-693f-4d41-9856-16e0aee7f01e" released by "delete_volume" :: held 1.447s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] Created reservations ['b8b63262-4deb-4318-a874-107b0fca2d1a', '6b1b22c0-41df-49ad-a2aa-03ee2d3ffeec', '862fb152-0a1a-427e-8ab6-145286180d8d', '89980770-954a-41f2-88df-0b2245619dfe'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:34 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:22:34 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] Acquiring lock "cinder-2652a021-1913-47aa-8cc0-345906ab66e1-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] Lock "cinder-2652a021-1913-47aa-8cc0-345906ab66e1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] Acquiring lock "cinder-quobyte-2652a021-1913-47aa-8cc0-345906ab66e1" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-2652a021-1913-47aa-8cc0-345906ab66e1" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1a32d2-3cdd-4e2d-b47d-96cb9250168a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2652a021-1913-47aa-8cc0-345906ab66e1 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:35 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2652a021-1913-47aa-8cc0-345906ab66e1 Jun 02 16:22:35 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-4f9d71ac-4ae3-4106-af5e-b486ea1c7484 req-7bdedc59-77a8-4f12-b8c4-b0846473536d tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-4f9d71ac-4ae3-4106-af5e-b486ea1c7484 req-7bdedc59-77a8-4f12-b8c4-b0846473536d tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[688a77e0-e68f-4436-a774-0053e75e47fa]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-4f9d71ac-4ae3-4106-af5e-b486ea1c7484 req-7bdedc59-77a8-4f12-b8c4-b0846473536d tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:35 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.634s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:22:35 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] Deleted volume successfully. Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7928422f-fb5b-4c9e-ab97-df5ec3c25e64 tempest-VolumesListTestJSON-803216603 None] Lock "cinder-d530a368-693f-4d41-9856-16e0aee7f01e-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:35 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b Jun 02 16:22:35 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] Acquiring lock "cinder-7f08ea5d-aecd-474c-ab70-bec764bbc257-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] Lock "cinder-7f08ea5d-aecd-474c-ab70-bec764bbc257-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] Acquiring lock "cinder-quobyte-7f08ea5d-aecd-474c-ab70-bec764bbc257" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] Lock "cinder-quobyte-7f08ea5d-aecd-474c-ab70-bec764bbc257" acquired by "delete_volume" :: waited 0.016s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25f7bb4-aaef-4900-93ce-4719bb70069e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f08ea5d-aecd-474c-ab70-bec764bbc257 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:35 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f08ea5d-aecd-474c-ab70-bec764bbc257 Jun 02 16:22:35 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:35 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2652a021-1913-47aa-8cc0-345906ab66e1" returned: 0 in 0.808s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2652a021-1913-47aa-8cc0-345906ab66e1 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:35 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2652a021-1913-47aa-8cc0-345906ab66e1 Jun 02 16:22:35 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:36 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-4f9d71ac-4ae3-4106-af5e-b486ea1c7484 req-7bdedc59-77a8-4f12-b8c4-b0846473536d tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b" returned: 0 in 0.906s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-4f9d71ac-4ae3-4106-af5e-b486ea1c7484 req-7bdedc59-77a8-4f12-b8c4-b0846473536d tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.935s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-4f9d71ac-4ae3-4106-af5e-b486ea1c7484 req-7bdedc59-77a8-4f12-b8c4-b0846473536d tempest-TestInstancesWithCinderVolumes-1552097342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c951452-f423-4559-8d3e-64624c999351', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:22:36 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-4f9d71ac-4ae3-4106-af5e-b486ea1c7484 req-7bdedc59-77a8-4f12-b8c4-b0846473536d tempest-TestInstancesWithCinderVolumes-1552097342 None] attachment_update completed successfully. Jun 02 16:22:36 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f08ea5d-aecd-474c-ab70-bec764bbc257" returned: 0 in 0.771s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f08ea5d-aecd-474c-ab70-bec764bbc257 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:36 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f08ea5d-aecd-474c-ab70-bec764bbc257 Jun 02 16:22:36 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:36 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2652a021-1913-47aa-8cc0-345906ab66e1" returned: 0 in 0.648s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-2652a021-1913-47aa-8cc0-345906ab66e1" released by "delete_volume" :: held 1.528s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:36 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] Created reservations ['abcc9803-c9c1-4daf-9f9e-e66bbb2f49b4', 'ebf5a92f-0ef9-488e-8410-bd4dcd845133', '1a26b195-605c-4f00-b7c6-bf3d974e4729', '0718ce3d-b8c9-4b97-9997-539c847e798c'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:22:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:36 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:22:36 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:37 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-7f08ea5d-aecd-474c-ab70-bec764bbc257" returned: 0 in 0.684s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] Lock "cinder-quobyte-7f08ea5d-aecd-474c-ab70-bec764bbc257" released by "delete_volume" :: held 1.511s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] Created reservations ['c0de6fc5-3fe2-45e3-a9d0-a511e8e1bd55', 'a54da268-226e-4a78-89a3-645c5dd35f7b', '2cba779f-642b-4f3a-8405-cdb5c089c524', '9793ab14-f5cd-4bac-a4b2-5d1c73ab74e7'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:37 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:22:37 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] Acquiring lock "cinder-34153052-5a44-4fbc-9f99-5f83d5e43940-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] Lock "cinder-34153052-5a44-4fbc-9f99-5f83d5e43940-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:37 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] Acquiring lock "cinder-quobyte-34153052-5a44-4fbc-9f99-5f83d5e43940" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.766s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:22:37 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] Deleted volume successfully. Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-34153052-5a44-4fbc-9f99-5f83d5e43940" acquired by "delete_volume" :: waited 0.029s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b48e474a-e8d5-4dfd-b4a7-d9cbfa957932 tempest-VolumesGetTest-337646348 None] Lock "cinder-2652a021-1913-47aa-8cc0-345906ab66e1-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cac5dbd-a8fa-48c8-8a5a-9d9162bac514]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34153052-5a44-4fbc-9f99-5f83d5e43940 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:37 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34153052-5a44-4fbc-9f99-5f83d5e43940 Jun 02 16:22:37 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] Acquiring lock "cinder-e1c1635e-3cff-4dbd-96c4-0ac5652f941f-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] Lock "cinder-e1c1635e-3cff-4dbd-96c4-0ac5652f941f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] Acquiring lock "cinder-quobyte-e1c1635e-3cff-4dbd-96c4-0ac5652f941f" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] Lock "cinder-quobyte-e1c1635e-3cff-4dbd-96c4-0ac5652f941f" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:38 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d00a0c-6de6-4fea-8476-447561d37a06]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:22:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e1c1635e-3cff-4dbd-96c4-0ac5652f941f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:38 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:38 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e1c1635e-3cff-4dbd-96c4-0ac5652f941f Jun 02 16:22:38 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.937s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:38 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:22:38 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] Deleted volume successfully. Jun 02 16:22:38 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c9da651a-0bb2-4b62-9821-c4081b3c4fff tempest-VolumesListTestJSON-803216603 None] Lock "cinder-7f08ea5d-aecd-474c-ab70-bec764bbc257-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:38 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34153052-5a44-4fbc-9f99-5f83d5e43940" returned: 0 in 0.977s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34153052-5a44-4fbc-9f99-5f83d5e43940 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:38 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34153052-5a44-4fbc-9f99-5f83d5e43940 Jun 02 16:22:38 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:38 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e1c1635e-3cff-4dbd-96c4-0ac5652f941f" returned: 0 in 0.771s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e1c1635e-3cff-4dbd-96c4-0ac5652f941f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:38 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e1c1635e-3cff-4dbd-96c4-0ac5652f941f Jun 02 16:22:38 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:39 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-34153052-5a44-4fbc-9f99-5f83d5e43940" returned: 0 in 0.619s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-34153052-5a44-4fbc-9f99-5f83d5e43940" released by "delete_volume" :: held 1.655s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] Created reservations ['c2de6eff-bc12-41bc-975f-85930dd59977', 'e5ffea10-b153-4683-871f-5f5cba3e5901', '36d0dc13-a1a9-4cc5-b106-d22b7cc151f2', 'e25d64f7-5275-4e81-85cb-8f8ee9bde9e9'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:39 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:22:39 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:39 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e1c1635e-3cff-4dbd-96c4-0ac5652f941f" returned: 0 in 0.627s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] Lock "cinder-quobyte-e1c1635e-3cff-4dbd-96c4-0ac5652f941f" released by "delete_volume" :: held 1.452s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] Created reservations ['9e40463c-3682-46f8-b5e9-bda60d238599', '79ba0c70-3207-492b-ace0-a2d46ba6e87a', '5728f649-0324-4f85-a054-8f44d9872456', '498b162d-18a0-41cc-9b3c-c476f7b842a8'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:39 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:22:39 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:39 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.719s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:22:40 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] Deleted volume successfully. Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d047bd81-7f03-4880-977f-c22269f63f6d tempest-VolumesGetTest-337646348 None] Lock "cinder-34153052-5a44-4fbc-9f99-5f83d5e43940-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Flow 'volume_create_manager' (0b92c775-e8c6-4456-a7e0-f449b98a121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3c57ec-df3c-440f-b5d4-2ca623d7b5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3c57ec-df3c-440f-b5d4-2ca623d7b5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1438057164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8333e06d-6b7b-4257-8dee-c8c3305cf0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427c72f1a9d04f53b67156bfa4d89e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:40Z,use_quota=True,user_id='ce748a22f5c84d51860c481c89a4da21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80df82c-d4c8-4233-9a17-4eacb682c65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80df82c-d4c8-4233-9a17-4eacb682c65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f254382c-798f-4cb2-8fb6-07f61f3caa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f254382c-798f-4cb2-8fb6-07f61f3caa4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8333e06d-6b7b-4257-8dee-c8c3305cf0fd', 'volume_name': 'volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12615337-50b4-493c-9631-6f7205105984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12615337-50b4-493c-9631-6f7205105984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f2ba74-224a-4add-aa9f-b601883a1fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:40 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Volume 8333e06d-6b7b-4257-8dee-c8c3305cf0fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd', 'volume_size': 1} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1438057164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8333e06d-6b7b-4257-8dee-c8c3305cf0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427c72f1a9d04f53b67156bfa4d89e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:40Z,use_quota=True,user_id='ce748a22f5c84d51860c481c89a4da21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Creating volume 8333e06d-6b7b-4257-8dee-c8c3305cf0fd {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:22:40 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:40 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd 1073741824 Jun 02 16:22:40 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:40 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.815s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:22:40 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] Deleted volume successfully. Jun 02 16:22:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6d0060ee-f047-4d22-a298-565a2c41c230 tempest-VolumesListTestJSON-803216603 None] Lock "cinder-e1c1635e-3cff-4dbd-96c4-0ac5652f941f-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:41 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd 1073741824" returned: 0 in 1.124s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:41 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd Jun 02 16:22:41 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:42 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd" returned: 0 in 0.738s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:22:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f2ba74-224a-4add-aa9f-b601883a1fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b621d4-7164-4b4e-a00d-39fdf984f586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:42 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Volume volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd (8333e06d-6b7b-4257-8dee-c8c3305cf0fd): created successfully Jun 02 16:22:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b621d4-7164-4b4e-a00d-39fdf984f586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Flow 'volume_create_manager' (0b92c775-e8c6-4456-a7e0-f449b98a121f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:42 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-d29912c6-5be7-44c9-8633-a1963cf25ec5 tempest-VolumesGetTest-337646348 None] Created volume successfully. Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Flow 'volume_create_manager' (b0eac8d9-052f-43f4-a17b-d60f15250641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd0c8c5-9268-462e-8135-9dcba37f453a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Flow 'volume_create_manager' (616b05bc-7fc7-47dc-8149-3d81b40f5abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4c24d7-948d-432f-a977-2c6d41989b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd0c8c5-9268-462e-8135-9dcba37f453a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1435977937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78be1520-adc7-4e1f-8621-f3cd31b8f678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efca1c4edaa74da2a5f44787d9a88be4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:44Z,use_quota=True,user_id='8244b8bd1a4a486da74140fcf72320f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218d9c7a-90ad-490b-9697-f6f813f5579a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218d9c7a-90ad-490b-9697-f6f813f5579a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d0b618-cb0a-4d09-81bb-f93c527bf8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d0b618-cb0a-4d09-81bb-f93c527bf8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78be1520-adc7-4e1f-8621-f3cd31b8f678', 'volume_name': 'volume-78be1520-adc7-4e1f-8621-f3cd31b8f678', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636cdaf3-46f8-41a1-aa25-0791da7b8100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636cdaf3-46f8-41a1-aa25-0791da7b8100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02beacd8-fcee-42dd-ac4c-1212547d4e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:43 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Volume 78be1520-adc7-4e1f-8621-f3cd31b8f678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78be1520-adc7-4e1f-8621-f3cd31b8f678', 'volume_size': 1} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1435977937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78be1520-adc7-4e1f-8621-f3cd31b8f678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efca1c4edaa74da2a5f44787d9a88be4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:44Z,use_quota=True,user_id='8244b8bd1a4a486da74140fcf72320f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Creating volume 78be1520-adc7-4e1f-8621-f3cd31b8f678 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:22:43 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:22:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-78be1520-adc7-4e1f-8621-f3cd31b8f678 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4c24d7-948d-432f-a977-2c6d41989b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-730072485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1beb60-5d49-44ba-acf9-6ce682875e8d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='427c72f1a9d04f53b67156bfa4d89e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8333e06d-6b7b-4257-8dee-c8c3305cf0fd,status='creating',terminated_at=None,updated_at=2026-06-02T14:22:44Z,use_quota=True,user_id='ce748a22f5c84d51860c481c89a4da21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa2f65b-28dd-4481-9497-1e9e3e5a7c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:44 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-78be1520-adc7-4e1f-8621-f3cd31b8f678 1073741824 Jun 02 16:22:44 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa2f65b-28dd-4481-9497-1e9e3e5a7c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81347d88-68b8-4194-b0f3-e5af708858df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81347d88-68b8-4194-b0f3-e5af708858df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ea1beb60-5d49-44ba-acf9-6ce682875e8d', 'volume_name': 'volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d', 'volume_size': 1, 'source_volid': '8333e06d-6b7b-4257-8dee-c8c3305cf0fd', 'source_volstatus': 'available'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a2ef11-c328-4254-affa-d5c2f1228b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a2ef11-c328-4254-affa-d5c2f1228b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38fb2a21-6101-4e2b-b911-463b8f5dda71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:44 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Volume ea1beb60-5d49-44ba-acf9-6ce682875e8d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d', 'volume_size': 1, 'source_volid': '8333e06d-6b7b-4257-8dee-c8c3305cf0fd', 'source_volstatus': 'available'} Jun 02 16:22:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:44 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-78be1520-adc7-4e1f-8621-f3cd31b8f678 1073741824" returned: 0 in 0.908s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-78be1520-adc7-4e1f-8621-f3cd31b8f678 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:44 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-78be1520-adc7-4e1f-8621-f3cd31b8f678 Jun 02 16:22:44 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-75bd4932-f670-40e0-a3da-294cb0ae200b req-7113581c-0a7a-4f66-a8ad-3bf3eb782f6a tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:45 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-ae280990-ff2e-46f7-ac7e-76ab3b0ffed6 tempest-TestShelveInstance-6591655 None] Terminate volume connection completed successfully. Jun 02 16:22:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-ae280990-ff2e-46f7-ac7e-76ab3b0ffed6 tempest-TestShelveInstance-6591655 None] Deleting attachment 67c32940-b2cb-42b4-9d3f-e9f2218852b1. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:22:45 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-78be1520-adc7-4e1f-8621-f3cd31b8f678" returned: 0 in 0.600s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:22:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.386s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:45 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Cloning volume 8333e06d-6b7b-4257-8dee-c8c3305cf0fd to volume ea1beb60-5d49-44ba-acf9-6ce682875e8d Jun 02 16:22:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02beacd8-fcee-42dd-ac4c-1212547d4e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78be1520-adc7-4e1f-8621-f3cd31b8f678', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47a2bd1-05b2-414d-bfbf-5bd4e2e00f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:22:45 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Volume volume-78be1520-adc7-4e1f-8621-f3cd31b8f678 (78be1520-adc7-4e1f-8621-f3cd31b8f678): created successfully Jun 02 16:22:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47a2bd1-05b2-414d-bfbf-5bd4e2e00f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:22:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Flow 'volume_create_manager' (b0eac8d9-052f-43f4-a17b-d60f15250641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:22:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Creating offline snapshot c9e91356-2858-4f3a-91d5-7bf121e8bd1c of volume 8333e06d-6b7b-4257-8dee-c8c3305cf0fd {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:22:45 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-c920f10b-12fd-4132-ba5e-3c3c871b179b tempest-VolumesNegativeTest-397450162 None] Created volume successfully. Jun 02 16:22:45 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d3f8a5-3c6b-4b7f-a67b-2af758ed0685]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:22:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:45 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd Jun 02 16:22:45 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Acquiring lock "cinder-6a95ec19-26a3-4b84-9b93-8d1771d7562b-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Lock "cinder-6a95ec19-26a3-4b84-9b93-8d1771d7562b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Acquiring lock "cinder-quobyte-6a95ec19-26a3-4b84-9b93-8d1771d7562b" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Lock "cinder-quobyte-6a95ec19-26a3-4b84-9b93-8d1771d7562b" acquired by "delete_volume" :: waited 0.024s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:46 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37186fc-f134-4bdb-b17f-73244319928e]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:22:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:46 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b Jun 02 16:22:46 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:46 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd" returned: 0 in 0.819s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:46 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c 1G Jun 02 16:22:46 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:46 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b" returned: 0 in 0.792s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:47 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b Jun 02 16:22:47 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:47 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c 1G" returned: 0 in 0.941s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:47 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c Jun 02 16:22:47 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:47 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b" returned: 1 in 0.729s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:22:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:47 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b Jun 02 16:22:47 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:48 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c" returned: 0 in 0.751s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:48 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c is being set with open permissions: ugo+rw Jun 02 16:22:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:48 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c Jun 02 16:22:48 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:48 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6a95ec19-26a3-4b84-9b93-8d1771d7562b" returned: 0 in 0.602s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Lock "cinder-quobyte-6a95ec19-26a3-4b84-9b93-8d1771d7562b" released by "delete_volume" :: held 2.206s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:48 devstack cinder-volume[86488]: DEBUG cinder.quota [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Created reservations ['69404efa-bf63-478d-89f2-955e252164dc', '0ba80a76-1fee-4b1c-b742-1494c314e30b', '3a659680-d48b-40e5-b2f1-6c5bb7e4f796', '92bd4d62-965a-461e-9e3d-83906fdc7b7e'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:22:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:48 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:22:48 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:48 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c" returned: 0 in 0.608s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:48 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.info Jun 02 16:22:48 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:49 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.761s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:49 devstack cinder-volume[86488]: DEBUG cinder.manager [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:22:49 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Deleted volume successfully. Jun 02 16:22:49 devstack cinder-volume[86488]: DEBUG cinder.coordination [req-fe2af64a-66b9-4033-a5d3-f95238865ea0 req-c2d3543a-0f7b-4d0d-b51c-2825bc02bdb1 tempest-TestShelveInstance-6591655 None] Lock "cinder-6a95ec19-26a3-4b84-9b93-8d1771d7562b-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:49 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.info" returned: 0 in 0.752s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:49 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.info is being set with open permissions: ugo+rw Jun 02 16:22:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:49 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.info Jun 02 16:22:49 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:50 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.info" returned: 0 in 0.693s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:50 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Acquiring lock "cinder-quobyte-ea1beb60-5d49-44ba-acf9-6ce682875e8d" by "_copy_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:50 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-ea1beb60-5d49-44ba-acf9-6ce682875e8d" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] snapshot: c9e91356-2858-4f3a-91d5-7bf121e8bd1c, volume: ea1beb60-5d49-44ba-acf9-6ce682875e8d, {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 16:22:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:22:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:22:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:22:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:22:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:22:50 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba77dc7f-466c-41a1-8d6a-3d4e8a92bddd]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:22:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:50 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c Jun 02 16:22:50 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:51 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c" returned: 0 in 0.765s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:22:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 16:22:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Creating direct copy from snapshot {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 16:22:51 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e808085f-dd81-49f7-9465-47d4e759d49d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:22:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:51 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd Jun 02 16:22:51 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:51 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd" returned: 0 in 0.821s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:51 devstack cinder-volume[86488]: DEBUG cinder.utils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Path /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d not found in is_blk_device check {{(pid=86488) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 16:22:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:51 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d Jun 02 16:22:51 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:58 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d" returned: 0 in 6.265s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:58 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d5b7c6-3634-44fb-b877-a4374733b915]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:22:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:58 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd Jun 02 16:22:58 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:58 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=62,cinder:UPDATE=84,cinder:DELETE=8,cinder:INSERT=18 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:22:59 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd" returned: 0 in 0.968s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:59 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Image conversion details: src /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:22:59 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Converted 1024.00 MB image at 163.42 MB/s Jun 02 16:22:59 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d is being set with open permissions: ugo+rw Jun 02 16:22:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:22:59 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d Jun 02 16:22:59 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:22:59 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=96,cinder:INSERT=29,cinder:UPDATE=124,cinder:DELETE=11 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:22:59 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Jun 02 16:22:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d" returned: 0 in 0.720s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:22:59 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-ea1beb60-5d49-44ba-acf9-6ce682875e8d" released by "_copy_volume_from_snapshot" :: held 9.648s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:22:59 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Acquiring lock "cinder-quobyte-c9e91356-2858-4f3a-91d5-7bf121e8bd1c" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:22:59 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-c9e91356-2858-4f3a-91d5-7bf121e8bd1c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:22:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Deleting offline snapshot c9e91356-2858-4f3a-91d5-7bf121e8bd1c of volume 8333e06d-6b7b-4257-8dee-c8c3305cf0fd {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:22:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] snapshot_file for this snap is: volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:22:59 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf28733e-745d-4c4e-a841-e26d44ed2d5e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:22:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:00 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c Jun 02 16:23:00 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:23:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:23:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:23:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:00 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:23:00 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:00 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:00 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c" returned: 0 in 0.865s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:23:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.803s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:00 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:23:00 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b390227-1774-4cd0-934c-8b9b90f61cff]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:23:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:01 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd Jun 02 16:23:01 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:02 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd" returned: 0 in 1.087s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:02 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c Jun 02 16:23:02 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:02 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c" returned: 0 in 0.934s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:03 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c Jun 02 16:23:03 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:03 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd.c9e91356-2858-4f3a-91d5-7bf121e8bd1c" returned: 0 in 0.852s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:03 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-c9e91356-2858-4f3a-91d5-7bf121e8bd1c" released by "_delete_snapshot" :: held 3.973s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.417s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-75bd4932-f670-40e0-a3da-294cb0ae200b req-7113581c-0a7a-4f66-a8ad-3bf3eb782f6a tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 18.789s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38fb2a21-6101-4e2b-b911-463b8f5dda71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d', 'volume_size': 1, 'source_volid': '8333e06d-6b7b-4257-8dee-c8c3305cf0fd', 'source_volstatus': 'available'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9362951d-5b26-4236-82f3-e5a3902fe3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:03 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[200b380d-a666-4440-836f-1d038238bffc]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:23:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-75bd4932-f670-40e0-a3da-294cb0ae200b req-7113581c-0a7a-4f66-a8ad-3bf3eb782f6a tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:04 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Volume volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d (ea1beb60-5d49-44ba-acf9-6ce682875e8d): created successfully Jun 02 16:23:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9362951d-5b26-4236-82f3-e5a3902fe3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Flow 'volume_create_manager' (616b05bc-7fc7-47dc-8149-3d81b40f5abf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:23:04 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-e01d8726-8fdd-40d8-98a3-3c0a0eeaa9cf tempest-VolumesGetTest-337646348 None] Created volume successfully. Jun 02 16:23:04 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569 Jun 02 16:23:04 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:04 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-75bd4932-f670-40e0-a3da-294cb0ae200b req-7113581c-0a7a-4f66-a8ad-3bf3eb782f6a tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569" returned: 0 in 1.006s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-75bd4932-f670-40e0-a3da-294cb0ae200b req-7113581c-0a7a-4f66-a8ad-3bf3eb782f6a tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.060s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-75bd4932-f670-40e0-a3da-294cb0ae200b req-7113581c-0a7a-4f66-a8ad-3bf3eb782f6a tempest-TestInstancesWithCinderVolumes-1552097342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c8b71fe-d7a3-4848-9988-f11676dadb41', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:23:05 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-75bd4932-f670-40e0-a3da-294cb0ae200b req-7113581c-0a7a-4f66-a8ad-3bf3eb782f6a tempest-TestInstancesWithCinderVolumes-1552097342 None] attachment_update completed successfully. Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Flow 'volume_create_manager' (7696e6d6-0d78-449a-b341-dae218b9d128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78193103-b391-4147-badb-2b02d7e1226e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78193103-b391-4147-badb-2b02d7e1226e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:23:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1397454946',display_name='tempest-VolumesGetTest-Volume-1515961265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb8fe32-0f01-4a3c-af87-822f17fec6ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427c72f1a9d04f53b67156bfa4d89e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:23:06Z,use_quota=True,user_id='ce748a22f5c84d51860c481c89a4da21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18c1db7-8c00-4942-814a-43dfe873568d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18c1db7-8c00-4942-814a-43dfe873568d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b7871a-16a6-4431-83ae-5def1e0e12ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b7871a-16a6-4431-83ae-5def1e0e12ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bb8fe32-0f01-4a3c-af87-822f17fec6ac', 'volume_name': 'volume-1bb8fe32-0f01-4a3c-af87-822f17fec6ac', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19f7e9d-9158-46b6-9345-a6ba025ff846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19f7e9d-9158-46b6-9345-a6ba025ff846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9ed78e-91a5-4d5d-9b13-c7ca2cfde315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:06 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Volume 1bb8fe32-0f01-4a3c-af87-822f17fec6ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bb8fe32-0f01-4a3c-af87-822f17fec6ac', 'volume_size': 1} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:23:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1397454946',display_name='tempest-VolumesGetTest-Volume-1515961265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb8fe32-0f01-4a3c-af87-822f17fec6ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427c72f1a9d04f53b67156bfa4d89e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:23:06Z,use_quota=True,user_id='ce748a22f5c84d51860c481c89a4da21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Creating volume 1bb8fe32-0f01-4a3c-af87-822f17fec6ac {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:23:06 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:23:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1bb8fe32-0f01-4a3c-af87-822f17fec6ac 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:06 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1bb8fe32-0f01-4a3c-af87-822f17fec6ac 1073741824 Jun 02 16:23:06 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:07 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1bb8fe32-0f01-4a3c-af87-822f17fec6ac 1073741824" returned: 0 in 0.986s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1bb8fe32-0f01-4a3c-af87-822f17fec6ac {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:07 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1bb8fe32-0f01-4a3c-af87-822f17fec6ac Jun 02 16:23:07 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:07 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1bb8fe32-0f01-4a3c-af87-822f17fec6ac" returned: 0 in 0.634s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:23:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9ed78e-91a5-4d5d-9b13-c7ca2cfde315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb8fe32-0f01-4a3c-af87-822f17fec6ac', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa5611b-a3f8-4c03-9350-3d4c5ef4a3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:07 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Volume volume-1bb8fe32-0f01-4a3c-af87-822f17fec6ac (1bb8fe32-0f01-4a3c-af87-822f17fec6ac): created successfully Jun 02 16:23:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa5611b-a3f8-4c03-9350-3d4c5ef4a3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Flow 'volume_create_manager' (7696e6d6-0d78-449a-b341-dae218b9d128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:23:08 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-a5c4692e-d69d-4b1f-86af-2434d7d99c90 tempest-VolumesGetTest-337646348 None] Created volume successfully. Jun 02 16:23:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] Acquiring lock "cinder-1bb8fe32-0f01-4a3c-af87-822f17fec6ac-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] Lock "cinder-1bb8fe32-0f01-4a3c-af87-822f17fec6ac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] Acquiring lock "cinder-quobyte-1bb8fe32-0f01-4a3c-af87-822f17fec6ac" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-1bb8fe32-0f01-4a3c-af87-822f17fec6ac" acquired by "delete_volume" :: waited 0.022s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:08 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1948ecfa-9f92-47ab-af06-06cd4825893c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:23:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1bb8fe32-0f01-4a3c-af87-822f17fec6ac {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:08 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1bb8fe32-0f01-4a3c-af87-822f17fec6ac Jun 02 16:23:08 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:09 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1bb8fe32-0f01-4a3c-af87-822f17fec6ac" returned: 0 in 0.893s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1bb8fe32-0f01-4a3c-af87-822f17fec6ac {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:09 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1bb8fe32-0f01-4a3c-af87-822f17fec6ac Jun 02 16:23:09 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:09 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-1bb8fe32-0f01-4a3c-af87-822f17fec6ac" returned: 0 in 0.689s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-1bb8fe32-0f01-4a3c-af87-822f17fec6ac" released by "delete_volume" :: held 1.647s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:10 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] Created reservations ['2b78d0c7-ba5a-4391-8cef-967f9bfbc1e3', '32c9cf4f-f104-42d2-8a82-0e219327f2e6', 'fb0ab087-0138-4afd-a6a9-11e3c8a1a6a8', '83a602de-8e64-42eb-987c-7883006c8636'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:23:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:23:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:23:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:10 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:23:10 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] Acquiring lock "cinder-ea1beb60-5d49-44ba-acf9-6ce682875e8d-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] Lock "cinder-ea1beb60-5d49-44ba-acf9-6ce682875e8d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] Acquiring lock "cinder-quobyte-ea1beb60-5d49-44ba-acf9-6ce682875e8d" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-ea1beb60-5d49-44ba-acf9-6ce682875e8d" acquired by "delete_volume" :: waited 0.037s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:11 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06bbe52-6be1-4d7a-9d15-573f394aba75]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:23:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:11 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d Jun 02 16:23:11 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:11 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.127s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:11 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:23:11 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] Deleted volume successfully. Jun 02 16:23:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f0ecb097-c363-4bbe-9423-130cc326c117 tempest-VolumesGetTest-337646348 None] Lock "cinder-1bb8fe32-0f01-4a3c-af87-822f17fec6ac-delete_volume" released by "delete_volume" :: held 3.077s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:11 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d" returned: 0 in 0.838s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:11 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d Jun 02 16:23:11 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:12 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ea1beb60-5d49-44ba-acf9-6ce682875e8d" returned: 0 in 0.796s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-ea1beb60-5d49-44ba-acf9-6ce682875e8d" released by "delete_volume" :: held 1.703s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:12 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] Created reservations ['a6b0efd2-5d39-443c-9719-620e69246804', 'fdb9a7dc-196b-4c5e-8ab2-a514c97f50c5', '81253cac-b64f-4dca-830a-1380dfd57c46', 'd21c6b10-247c-4e00-b08d-26e069c54a61'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:23:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:12 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:23:12 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:23:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:12 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:23:12 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] Acquiring lock "cinder-8333e06d-6b7b-4257-8dee-c8c3305cf0fd-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] Lock "cinder-8333e06d-6b7b-4257-8dee-c8c3305cf0fd-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] Acquiring lock "cinder-quobyte-8333e06d-6b7b-4257-8dee-c8c3305cf0fd" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-8333e06d-6b7b-4257-8dee-c8c3305cf0fd" acquired by "delete_volume" :: waited 0.038s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:13 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[560cdfd3-7dd3-41c2-9664-0cc365ffec50]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:23:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:13 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd Jun 02 16:23:13 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:13 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.035s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:13 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:23:13 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] Deleted volume successfully. Jun 02 16:23:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-abaa764a-294b-4c89-8a20-83d966d1bfac tempest-VolumesGetTest-337646348 None] Lock "cinder-ea1beb60-5d49-44ba-acf9-6ce682875e8d-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:14 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd" returned: 0 in 1.052s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:14 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd Jun 02 16:23:14 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:15 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8333e06d-6b7b-4257-8dee-c8c3305cf0fd" returned: 0 in 0.886s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-8333e06d-6b7b-4257-8dee-c8c3305cf0fd" released by "delete_volume" :: held 2.060s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:15 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] Created reservations ['f642659b-98f5-4321-a5ec-5a816808a902', 'c29ec4bb-be62-4d9f-9003-83cab26ac444', 'c6f66009-9706-4312-9801-6408f33a09d9', 'baf70b0a-d7e2-44d1-99a0-a78cb2aee28b'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:23:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:15 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:23:15 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:23:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:15 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:23:15 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:15 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-42254073-5b95-40bd-aef2-85987d41f87a req-d12c043d-9ef3-46d8-a0e0-5de0bab08196 tempest-TestInstancesWithCinderVolumes-1552097342 None] Terminate volume connection completed successfully. Jun 02 16:23:15 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-42254073-5b95-40bd-aef2-85987d41f87a req-d12c043d-9ef3-46d8-a0e0-5de0bab08196 tempest-TestInstancesWithCinderVolumes-1552097342 None] Deleting attachment 8c951452-f423-4559-8d3e-64624c999351. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:23:16 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.826s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:16 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:23:16 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] Deleted volume successfully. Jun 02 16:23:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-63244736-11fb-475e-b94c-3c6c26cfed9c tempest-VolumesGetTest-337646348 None] Lock "cinder-8333e06d-6b7b-4257-8dee-c8c3305cf0fd-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "cinder-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "cinder-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:17 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:23:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Flow 'volume_create_manager' (a4c273b2-3b59-4d6d-b955-163e9f4c39bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:23:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68637622-abbf-4b57-8230-d070792e31a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "cinder-quobyte-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68637622-abbf-4b57-8230-d070792e31a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1093084540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17bb254-841f-4327-b5c8-e3c9ae4c5554,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='427c72f1a9d04f53b67156bfa4d89e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:23:18Z,use_quota=True,user_id='ce748a22f5c84d51860c481c89a4da21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29732a19-ef60-40bd-8811-25c38337a877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29732a19-ef60-40bd-8811-25c38337a877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a88061-ec43-45d5-ad7d-b285d87db461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:17 devstack cinder-volume[86488]: DEBUG cinder.image.glance [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Creating Keystone auth plugin from conf {{(pid=86488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 16:23:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "cinder-quobyte-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b" acquired by "delete_volume" :: waited 0.044s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:17 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[db46a7df-4d07-426b-b0e4-1ccf4b3f461c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:23:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:17 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b Jun 02 16:23:17 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a88061-ec43-45d5-ad7d-b285d87db461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd17bb254-841f-4327-b5c8-e3c9ae4c5554', 'volume_name': 'volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554', 'volume_size': 1, 'image_id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '802a1494b5514d5c94e7154c7dda716e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'created_at': datetime.datetime(2026, 6, 2, 14, 3, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 3, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8659fae9-5d16-4972-a7f7-34f56b7f45f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8659fae9-5d16-4972-a7f7-34f56b7f45f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdaa5c20-4c6a-475a-bb65-526117209332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:18 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Volume d17bb254-841f-4327-b5c8-e3c9ae4c5554: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554', 'volume_size': 1, 'image_id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '802a1494b5514d5c94e7154c7dda716e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'created_at': datetime.datetime(2026, 6, 2, 14, 3, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 3, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 02 16:23:18 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Trying to clone d17bb254-841f-4327-b5c8-e3c9ae4c5554 from image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}]). {{(pid=86488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 02 16:23:18 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b" returned: 0 in 1.022s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:18 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b Jun 02 16:23:18 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:19 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_e06rnqqydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 16:23:19 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Image download 20.69 MB at 20.69 MB/s Jun 02 16:23:19 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6e8fad-cfba-4e00-b382-d1fb45d8eaab]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:23:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_e06rnqqydevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:19 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_e06rnqqydevstack@QuobyteHD Jun 02 16:23:19 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:19 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b" returned: 0 in 1.092s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "cinder-quobyte-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b" released by "delete_volume" :: held 2.200s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:20 devstack cinder-volume[86488]: WARNING cinder.quota [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1159262140-874037570 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1159262140-874037570, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:23:20 devstack cinder-volume[86488]: WARNING cinder.quota [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1159262140-874037570 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1159262140-874037570, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:23:20 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Created reservations ['36ae75f2-1bff-4d7b-a345-5545e8afb070', '3e157587-0894-4935-b04c-ec9efb871638', 'a484bb20-ddae-42e2-ba69-99586c3f1060', 'bc855085-46f3-4989-90b2-da3ec30e9a9b'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:23:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:23:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:23:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:20 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:23:20 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:20 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_e06rnqqydevstack@QuobyteHD" returned: 0 in 1.179s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:20 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Temporary image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 is fetched for user ce748a22f5c84d51860c481c89a4da21. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 16:23:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] Acquiring lock "cinder-78be1520-adc7-4e1f-8621-f3cd31b8f678-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] Lock "cinder-78be1520-adc7-4e1f-8621-f3cd31b8f678-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:20 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda2fc44-def3-4d2a-82d3-218e28acc419]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:23:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_e06rnqqydevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] Acquiring lock "cinder-quobyte-78be1520-adc7-4e1f-8621-f3cd31b8f678" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] Lock "cinder-quobyte-78be1520-adc7-4e1f-8621-f3cd31b8f678" acquired by "delete_volume" :: waited 0.030s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:20 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07dfaa5-a234-4509-b545-3f7e6c272ad9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:23:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-78be1520-adc7-4e1f-8621-f3cd31b8f678 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:20 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_e06rnqqydevstack@QuobyteHD Jun 02 16:23:20 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:20 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-78be1520-adc7-4e1f-8621-f3cd31b8f678 Jun 02 16:23:20 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:21 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.880s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:21 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:23:21 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Deleted volume successfully. Jun 02 16:23:21 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-56a7ff08-53ae-4fe3-9b57-b4ce54a1a5ad tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "cinder-a1495d12-5a93-49a4-ac5a-c7d75f4ab59b-delete_volume" released by "delete_volume" :: held 3.522s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:21 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_e06rnqqydevstack@QuobyteHD" returned: 0 in 0.975s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1093084540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17bb254-841f-4327-b5c8-e3c9ae4c5554,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='427c72f1a9d04f53b67156bfa4d89e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:23:18Z,use_quota=True,user_id='ce748a22f5c84d51860c481c89a4da21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:23:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Creating volume d17bb254-841f-4327-b5c8-e3c9ae4c5554 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:23:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:23:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:23:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:23:21 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:23:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:21 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 1073741824 Jun 02 16:23:21 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:21 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-78be1520-adc7-4e1f-8621-f3cd31b8f678" returned: 0 in 1.032s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-78be1520-adc7-4e1f-8621-f3cd31b8f678 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:21 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-78be1520-adc7-4e1f-8621-f3cd31b8f678 Jun 02 16:23:21 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:22 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-78be1520-adc7-4e1f-8621-f3cd31b8f678" returned: 0 in 0.724s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] Lock "cinder-quobyte-78be1520-adc7-4e1f-8621-f3cd31b8f678" released by "delete_volume" :: held 1.816s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:22 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] Created reservations ['0a10c736-e630-4737-9fd0-dbd0c303de45', '527ef94b-1ef4-4c8a-bd3f-5b7d7e903f37', '43dafddc-154f-4b84-ba6b-93bc39467edf', '5900968a-72db-4fb4-8cff-bfac0e9da872'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:23:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:23:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:23:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:22 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 1073741824" returned: 0 in 1.017s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:22 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:23:22 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:22 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 Jun 02 16:23:22 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:23 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.815s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:23 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:23:23 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] Deleted volume successfully. Jun 02 16:23:23 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-ba4157c9-1629-4eaf-bd8a-2dccdc6294f6 req-5d36958f-49ee-4fa4-99bc-2055f896afe2 tempest-TestInstancesWithCinderVolumes-1552097342 None] Terminate volume connection completed successfully. Jun 02 16:23:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-ba4157c9-1629-4eaf-bd8a-2dccdc6294f6 req-5d36958f-49ee-4fa4-99bc-2055f896afe2 tempest-TestInstancesWithCinderVolumes-1552097342 None] Deleting attachment 2c8b71fe-d7a3-4848-9988-f11676dadb41. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:23:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-aece8b0c-c2c3-4b2f-a1f2-e3d0de6f9069 tempest-VolumesNegativeTest-397450162 None] Lock "cinder-78be1520-adc7-4e1f-8621-f3cd31b8f678-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:23 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554" returned: 0 in 0.928s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:23 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:23:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:23 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Attempting download of d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}])) to volume d17bb254-841f-4327-b5c8-e3c9ae4c5554. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 16:23:23 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c30005-0c6f-4abe-b56a-1fadb352fcbf]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:23:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_29b8ch_h {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:23 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_29b8ch_h Jun 02 16:23:23 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:24 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_29b8ch_h" returned: 0 in 0.831s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_29b8ch_h {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:24 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_29b8ch_h Jun 02 16:23:24 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:25 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_29b8ch_h" returned: 1 in 0.715s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_29b8ch_h' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:23:25 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae139cb7-885b-4e76-87ff-d3fb83c5081c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:23:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_e06rnqqydevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:25 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_e06rnqqydevstack@QuobyteHD Jun 02 16:23:25 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "cinder-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "cinder-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "cinder-quobyte-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "cinder-quobyte-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569" acquired by "delete_volume" :: waited 0.032s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:25 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a9fc70-0d51-4a8d-bfee-a48ffe1c2d2d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:23:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:25 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569 Jun 02 16:23:25 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:26 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_e06rnqqydevstack@QuobyteHD" returned: 0 in 1.092s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:26 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 was qcow2, converting to raw {{(pid=86488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 16:23:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_e06rnqqydevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:26 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_e06rnqqydevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 Jun 02 16:23:26 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:26 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569" returned: 0 in 1.186s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:26 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569 Jun 02 16:23:26 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:27 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569" returned: 0 in 0.861s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:27 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "cinder-quobyte-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569" released by "delete_volume" :: held 2.126s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:27 devstack cinder-volume[86488]: WARNING cinder.quota [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1881959124-606409872 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1881959124-606409872, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:23:27 devstack cinder-volume[86488]: WARNING cinder.quota [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1881959124-606409872 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1881959124-606409872, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:23:27 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Created reservations ['565c30be-ce19-4683-9c51-eed1c63bd180', 'e191978c-d3d8-48bc-bae6-b65bb747e79a', '55b7573b-6085-4ca9-8f21-12625a1a3890', 'c70aa7f2-17ef-471a-98d4-9fe3e2f371b8'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:23:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:27 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:23:27 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:23:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:27 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:23:27 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:28 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.867s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:28 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:23:28 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Deleted volume successfully. Jun 02 16:23:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-64611586-7182-4613-adf9-a000fe7288e8 tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "cinder-9b10ba3e-1ee7-406e-8a0d-c1198ad7e569-delete_volume" released by "delete_volume" :: held 3.315s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:29 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_e06rnqqydevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554" returned: 0 in 2.772s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:29 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d0dd4d77-2a77-4ebb-8856-23ef7795d8d9_e06rnqqydevstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:23:29 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Converted 112.00 MB image at 40.37 MB/s Jun 02 16:23:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:29 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 1G Jun 02 16:23:29 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:29 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 1G" returned: 0 in 0.791s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:30 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[260d41a0-9919-4cf8-ba66-b8490b0710c5]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:23:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:30 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 Jun 02 16:23:30 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:30 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554" returned: 0 in 0.816s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:30 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 Jun 02 16:23:30 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:31 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554" returned: 1 in 0.797s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:23:31 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Downloaded image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}])) to volume d17bb254-841f-4327-b5c8-e3c9ae4c5554 successfully. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 16:23:31 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Temporary image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 for user ce748a22f5c84d51860c481c89a4da21 is deleted. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 16:23:31 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Marking volume d17bb254-841f-4327-b5c8-e3c9ae4c5554 as bootable. {{(pid=86488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 16:23:31 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Copying metadata from image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 to d17bb254-841f-4327-b5c8-e3c9ae4c5554. {{(pid=86488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 16:23:31 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Creating volume glance metadata for volume d17bb254-841f-4327-b5c8-e3c9ae4c5554 backed by image d0dd4d77-2a77-4ebb-8856-23ef7795d8d9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 16:23:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdaa5c20-4c6a-475a-bb65-526117209332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554', 'volume_size': 1, 'image_id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '802a1494b5514d5c94e7154c7dda716e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd0dd4d77-2a77-4ebb-8856-23ef7795d8d9', 'created_at': datetime.datetime(2026, 6, 2, 14, 3, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 3, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0dd4d77-2a77-4ebb-8856-23ef7795d8d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9766386e-4150-4d6b-a59d-a0bad3f0c1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:31 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Volume volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 (d17bb254-841f-4327-b5c8-e3c9ae4c5554): created successfully Jun 02 16:23:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9766386e-4150-4d6b-a59d-a0bad3f0c1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Flow 'volume_create_manager' (a4c273b2-3b59-4d6d-b955-163e9f4c39bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:23:31 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-ae638455-646a-4a78-a9ef-a17e125b7717 tempest-VolumesGetTest-337646348 None] Created volume successfully. Jun 02 16:23:33 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:23:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Flow 'volume_create_manager' (b53a4289-b795-4cc1-99e9-17699983eeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:23:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7119a0cd-af3e-4ba2-8b1b-d1d435cd9fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7119a0cd-af3e-4ba2-8b1b-d1d435cd9fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:23:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1371550123',display_name='tempest-VolumesGetTest-Volume-2025355890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a00d16b-6c4e-4c97-bd59-cdb3aecef991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427c72f1a9d04f53b67156bfa4d89e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:23:34Z,use_quota=True,user_id='ce748a22f5c84d51860c481c89a4da21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ccce94-7bb5-4b8b-b400-06f844992ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ccce94-7bb5-4b8b-b400-06f844992ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837430e7-d8cd-47ce-969b-657b4ff84081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837430e7-d8cd-47ce-969b-657b4ff84081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a00d16b-6c4e-4c97-bd59-cdb3aecef991', 'volume_name': 'volume-4a00d16b-6c4e-4c97-bd59-cdb3aecef991', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ff4ebc-7b11-4463-8341-1563c0f5bbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ff4ebc-7b11-4463-8341-1563c0f5bbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b0e7de-eda1-4abf-a30a-53074bcc16b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:34 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Volume 4a00d16b-6c4e-4c97-bd59-cdb3aecef991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a00d16b-6c4e-4c97-bd59-cdb3aecef991', 'volume_size': 1} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:23:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1371550123',display_name='tempest-VolumesGetTest-Volume-2025355890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a00d16b-6c4e-4c97-bd59-cdb3aecef991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427c72f1a9d04f53b67156bfa4d89e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:23:34Z,use_quota=True,user_id='ce748a22f5c84d51860c481c89a4da21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Creating volume 4a00d16b-6c4e-4c97-bd59-cdb3aecef991 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:23:34 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:23:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4a00d16b-6c4e-4c97-bd59-cdb3aecef991 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:34 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4a00d16b-6c4e-4c97-bd59-cdb3aecef991 1073741824 Jun 02 16:23:34 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:35 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4a00d16b-6c4e-4c97-bd59-cdb3aecef991 1073741824" returned: 0 in 1.033s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4a00d16b-6c4e-4c97-bd59-cdb3aecef991 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:35 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4a00d16b-6c4e-4c97-bd59-cdb3aecef991 Jun 02 16:23:35 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:35 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4a00d16b-6c4e-4c97-bd59-cdb3aecef991" returned: 0 in 0.646s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:35 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:23:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b0e7de-eda1-4abf-a30a-53074bcc16b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a00d16b-6c4e-4c97-bd59-cdb3aecef991', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9334f0-55d2-4071-83db-4765133a362c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:35 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Volume volume-4a00d16b-6c4e-4c97-bd59-cdb3aecef991 (4a00d16b-6c4e-4c97-bd59-cdb3aecef991): created successfully Jun 02 16:23:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9334f0-55d2-4071-83db-4765133a362c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Flow 'volume_create_manager' (b53a4289-b795-4cc1-99e9-17699983eeb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:23:35 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-65149491-2603-44f6-9862-b091ccb7385b tempest-VolumesGetTest-337646348 None] Created volume successfully. Jun 02 16:23:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] Acquiring lock "cinder-4a00d16b-6c4e-4c97-bd59-cdb3aecef991-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] Lock "cinder-4a00d16b-6c4e-4c97-bd59-cdb3aecef991-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] Acquiring lock "cinder-quobyte-4a00d16b-6c4e-4c97-bd59-cdb3aecef991" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-4a00d16b-6c4e-4c97-bd59-cdb3aecef991" acquired by "delete_volume" :: waited 0.016s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:36 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0276f0e-2f84-4e66-aef9-e3fbe58f9bc7]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:23:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4a00d16b-6c4e-4c97-bd59-cdb3aecef991 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:36 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4a00d16b-6c4e-4c97-bd59-cdb3aecef991 Jun 02 16:23:36 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:37 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4a00d16b-6c4e-4c97-bd59-cdb3aecef991" returned: 0 in 0.854s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4a00d16b-6c4e-4c97-bd59-cdb3aecef991 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:37 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4a00d16b-6c4e-4c97-bd59-cdb3aecef991 Jun 02 16:23:37 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:38 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-4a00d16b-6c4e-4c97-bd59-cdb3aecef991" returned: 0 in 0.800s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:38 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-4a00d16b-6c4e-4c97-bd59-cdb3aecef991" released by "delete_volume" :: held 1.730s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:38 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] Created reservations ['3ff8d640-5179-4bf3-9210-0b63c694bb37', 'a24ad300-e152-42ee-9553-5f9da9f20d70', '56879dc8-6909-4955-98dc-0ceca7ef0039', '1ef3cb7c-9fa7-44f6-91e4-5e41c6f65902'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:23:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:23:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:23:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:38 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:23:38 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:38 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Acquiring lock "cinder-d17bb254-841f-4327-b5c8-e3c9ae4c5554-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:38 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Lock "cinder-d17bb254-841f-4327-b5c8-e3c9ae4c5554-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:38 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Acquiring lock "cinder-quobyte-d17bb254-841f-4327-b5c8-e3c9ae4c5554" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:38 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-d17bb254-841f-4327-b5c8-e3c9ae4c5554" acquired by "delete_volume" :: waited 0.037s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:38 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ab07c7-25f5-4f9a-a3cb-d38f5b077079]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:23:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:39 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 Jun 02 16:23:39 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:39 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.104s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:39 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:23:39 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] Deleted volume successfully. Jun 02 16:23:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3f85ea4c-9540-47e1-96b0-999d57a923f8 tempest-VolumesGetTest-337646348 None] Lock "cinder-4a00d16b-6c4e-4c97-bd59-cdb3aecef991-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:40 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554" returned: 0 in 1.162s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:40 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 Jun 02 16:23:40 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:40 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554" returned: 1 in 0.915s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:23:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:41 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554 Jun 02 16:23:41 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Flow 'volume_create_manager' (4b9eccc4-6464-4afa-955d-84b236c984d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d9fe44-4f5a-4665-bd5f-e4222d919254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d9fe44-4f5a-4665-bd5f-e4222d919254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-586335773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e73d250-c906-4381-9237-9091b7933b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3324bc01784ab187313f0787000a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:23:41Z,use_quota=True,user_id='b8593bf057a64ea8a27ddfdd08862a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2578d8b-4830-4bd7-a48d-814be73d9692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2578d8b-4830-4bd7-a48d-814be73d9692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627747d2-3f8f-4175-96ff-e37009bc0f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627747d2-3f8f-4175-96ff-e37009bc0f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e73d250-c906-4381-9237-9091b7933b78', 'volume_name': 'volume-2e73d250-c906-4381-9237-9091b7933b78', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88685fe6-4b31-4365-a4ab-eb242f32883b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88685fe6-4b31-4365-a4ab-eb242f32883b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3638c9f6-a0c4-4844-818e-91d25299b1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:41 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Volume 2e73d250-c906-4381-9237-9091b7933b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e73d250-c906-4381-9237-9091b7933b78', 'volume_size': 1} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-586335773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e73d250-c906-4381-9237-9091b7933b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3324bc01784ab187313f0787000a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:23:41Z,use_quota=True,user_id='b8593bf057a64ea8a27ddfdd08862a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Creating volume 2e73d250-c906-4381-9237-9091b7933b78 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:23:41 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:23:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:41 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 1073741824 Jun 02 16:23:41 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:42 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d17bb254-841f-4327-b5c8-e3c9ae4c5554" returned: 0 in 1.022s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Lock "cinder-quobyte-d17bb254-841f-4327-b5c8-e3c9ae4c5554" released by "delete_volume" :: held 3.196s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:42 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Created reservations ['ea818ccc-a68d-4197-bc02-0b773763cf4b', 'f17e096c-a878-4e7a-9980-71851ef9bd1b', '59f7444e-7786-4e2a-b109-6e60c75232ce', '06e138c5-6ddc-4bfa-b8d6-9c06d9fbbcb2'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:23:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:23:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:23:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:42 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:23:42 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:42 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-0a65e7f0-2cb7-4a15-b250-a5c41c3f1f81 req-b534d3d4-8bc2-42d9-be15-9a8ad6af5f3e tempest-TestInstancesWithCinderVolumes-1552097342 None] Terminate volume connection completed successfully. Jun 02 16:23:42 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-0a65e7f0-2cb7-4a15-b250-a5c41c3f1f81 req-b534d3d4-8bc2-42d9-be15-9a8ad6af5f3e tempest-TestInstancesWithCinderVolumes-1552097342 None] Deleting attachment ca43b52c-3d0f-43f1-ac63-fdd7c2f47406. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:23:42 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 1073741824" returned: 0 in 1.213s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:42 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 Jun 02 16:23:42 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:42 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.705s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:42 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:23:42 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Deleted volume successfully. Jun 02 16:23:43 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2eea142b-776d-40a0-83e5-a440730145d5 tempest-VolumesGetTest-337646348 None] Lock "cinder-d17bb254-841f-4327-b5c8-e3c9ae4c5554-delete_volume" released by "delete_volume" :: held 4.293s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:43 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78" returned: 0 in 0.978s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] <== create_volume: return (2270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:23:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.273s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3638c9f6-a0c4-4844-818e-91d25299b1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e73d250-c906-4381-9237-9091b7933b78', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c528a66f-64c8-4111-9b41-76e867ae99f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:43 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Volume volume-2e73d250-c906-4381-9237-9091b7933b78 (2e73d250-c906-4381-9237-9091b7933b78): created successfully Jun 02 16:23:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c528a66f-64c8-4111-9b41-76e867ae99f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Flow 'volume_create_manager' (4b9eccc4-6464-4afa-955d-84b236c984d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:23:43 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f4a04ab1-6507-4d4a-9481-f8a7ef7fe177 tempest-TestStampPattern-1149610376 None] Created volume successfully. Jun 02 16:23:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "cinder-3303e87e-635e-44cf-907f-06df6f2a7454-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "cinder-3303e87e-635e-44cf-907f-06df6f2a7454-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "cinder-quobyte-3303e87e-635e-44cf-907f-06df6f2a7454" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:23:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "cinder-quobyte-3303e87e-635e-44cf-907f-06df6f2a7454" acquired by "delete_volume" :: waited 0.021s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:23:47 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad08a6f0-4274-4a96-966b-728004506658]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:23:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:47 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 Jun 02 16:23:47 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:48 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454" returned: 0 in 0.944s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:48 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 Jun 02 16:23:48 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:48 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454" returned: 1 in 0.791s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:23:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:48 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454 Jun 02 16:23:48 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:49 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-3303e87e-635e-44cf-907f-06df6f2a7454" returned: 0 in 0.765s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:49 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "cinder-quobyte-3303e87e-635e-44cf-907f-06df6f2a7454" released by "delete_volume" :: held 2.592s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:49 devstack cinder-volume[86488]: WARNING cinder.quota [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1559693934-1369418814 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1559693934-1369418814, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:23:49 devstack cinder-volume[86488]: WARNING cinder.quota [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1559693934-1369418814 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1559693934-1369418814, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:23:49 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Created reservations ['ac1039a4-f93c-430e-8677-f47d6d166875', '51977d98-1588-4041-8686-50517d807381', '2335ecb2-ff60-40d1-bf92-67d2e2bcd88a', '7d4cc970-eff1-48a2-bf9c-dc89e740550c'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:23:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:49 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:23:49 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:23:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:49 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:23:49 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:50 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.861s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:50 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:23:50 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Deleted volume successfully. Jun 02 16:23:50 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-574246ce-f768-4401-b771-546c1659702b tempest-TestInstancesWithCinderVolumes-1552097342 None] Lock "cinder-3303e87e-635e-44cf-907f-06df6f2a7454-delete_volume" released by "delete_volume" :: held 3.712s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Flow 'volume_create_manager' (7583375f-08ad-4a6a-89ca-18b11a4c9456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee391fe-c440-4c1f-a59f-7317229826f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee391fe-c440-4c1f-a59f-7317229826f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1328944033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec6be68-97aa-4381-8c52-4a36beca75ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='666d85b66fd44430ad105911a94aa7c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:23:53Z,use_quota=True,user_id='c91d28e80d1e4386a677480745789f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbde5f8-4cf7-486e-88b6-a3a7988598ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbde5f8-4cf7-486e-88b6-a3a7988598ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8808ccbc-615b-484d-9b2d-5c7b201f1097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8808ccbc-615b-484d-9b2d-5c7b201f1097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aec6be68-97aa-4381-8c52-4a36beca75ee', 'volume_name': 'volume-aec6be68-97aa-4381-8c52-4a36beca75ee', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6489a240-4c67-4260-aa80-4c43eea903fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6489a240-4c67-4260-aa80-4c43eea903fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46fc461d-2620-4851-8068-53e3c98a3dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:53 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Volume aec6be68-97aa-4381-8c52-4a36beca75ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aec6be68-97aa-4381-8c52-4a36beca75ee', 'volume_size': 1} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1328944033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec6be68-97aa-4381-8c52-4a36beca75ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='666d85b66fd44430ad105911a94aa7c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:23:53Z,use_quota=True,user_id='c91d28e80d1e4386a677480745789f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Creating volume aec6be68-97aa-4381-8c52-4a36beca75ee {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:23:53 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aec6be68-97aa-4381-8c52-4a36beca75ee 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:53 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aec6be68-97aa-4381-8c52-4a36beca75ee 1073741824 Jun 02 16:23:53 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:23:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Flow 'volume_create_manager' (3f3975c1-ff52-41ec-a072-b3262ecbfb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:23:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b64434a-474e-4e6e-8b05-a6c8428a078b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b64434a-474e-4e6e-8b05-a6c8428a078b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1310541911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f5e802-8239-4ba5-9660-c9e6d109cbf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='666d85b66fd44430ad105911a94aa7c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:23:54Z,use_quota=True,user_id='c91d28e80d1e4386a677480745789f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb5eb63-442c-4eb5-a30c-1b198dc7b3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb5eb63-442c-4eb5-a30c-1b198dc7b3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36466526-6872-4ee1-8597-efdd03182032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36466526-6872-4ee1-8597-efdd03182032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f5e802-8239-4ba5-9660-c9e6d109cbf8', 'volume_name': 'volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec2a912-2f86-47f1-895f-8012a2fff530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec2a912-2f86-47f1-895f-8012a2fff530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4864e392-82e5-4310-a820-cb5b05e5d7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:54 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Volume 49f5e802-8239-4ba5-9660-c9e6d109cbf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8', 'volume_size': 1} Jun 02 16:23:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:54 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aec6be68-97aa-4381-8c52-4a36beca75ee 1073741824" returned: 0 in 1.130s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aec6be68-97aa-4381-8c52-4a36beca75ee {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:54 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aec6be68-97aa-4381-8c52-4a36beca75ee Jun 02 16:23:54 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:55 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aec6be68-97aa-4381-8c52-4a36beca75ee" returned: 0 in 0.663s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:55 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:23:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.262s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:55 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1310541911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f5e802-8239-4ba5-9660-c9e6d109cbf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='666d85b66fd44430ad105911a94aa7c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:23:54Z,use_quota=True,user_id='c91d28e80d1e4386a677480745789f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:23:55 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Creating volume 49f5e802-8239-4ba5-9660-c9e6d109cbf8 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:23:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:23:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:23:55 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:23:55 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:23:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:55 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:23:55 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:23:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46fc461d-2620-4851-8068-53e3c98a3dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aec6be68-97aa-4381-8c52-4a36beca75ee', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:55 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8 1073741824 Jun 02 16:23:55 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7289e748-a853-4ddb-aeef-880ef017a230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:55 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Volume volume-aec6be68-97aa-4381-8c52-4a36beca75ee (aec6be68-97aa-4381-8c52-4a36beca75ee): created successfully Jun 02 16:23:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7289e748-a853-4ddb-aeef-880ef017a230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Flow 'volume_create_manager' (7583375f-08ad-4a6a-89ca-18b11a4c9456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:23:55 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-6f370b19-23fb-459e-8f1f-33634826fd2c tempest-TestServerVolumeAttachmentScenario-324933275 None] Created volume successfully. Jun 02 16:23:56 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8 1073741824" returned: 0 in 1.046s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:23:56 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8 Jun 02 16:23:56 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:23:57 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Jun 02 16:23:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8" returned: 0 in 0.700s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:23:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:23:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:23:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4864e392-82e5-4310-a820-cb5b05e5d7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0acea7-f388-4446-8fc5-24c2222617f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:23:57 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Volume volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8 (49f5e802-8239-4ba5-9660-c9e6d109cbf8): created successfully Jun 02 16:23:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0acea7-f388-4446-8fc5-24c2222617f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:23:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Flow 'volume_create_manager' (3f3975c1-ff52-41ec-a072-b3262ecbfb78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:23:57 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-a6cfa5d7-9d79-46d7-bb16-dc710b1db134 tempest-TestServerVolumeAttachmentScenario-324933275 None] Created volume successfully. Jun 02 16:24:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:24:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:24:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:24:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:24:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:00 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:24:00 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:00 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.701s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:00 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:UPDATE=94,cinder:INSERT=27,cinder:DELETE=9,cinder:SELECT=75 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:UPDATE=100,cinder:SELECT=72,cinder:INSERT=29,cinder:DELETE=7 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Flow 'volume_create_manager' (61b593da-b0ce-495e-beec-26be2423a9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e55381c-ab16-4e71-834b-19ebd26275d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e55381c-ab16-4e71-834b-19ebd26275d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1256128370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b627e95-4e42-4a2d-bcef-07b153d13a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362965b0bc6444dbdab8649130943e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:24:01Z,use_quota=True,user_id='baa248c702ca48cb9dbf2bf1d3305aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ff5eff-bbe3-4026-a743-97d35245a9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ff5eff-bbe3-4026-a743-97d35245a9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e01bae-ca65-4f60-b131-0bc2364a2e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e01bae-ca65-4f60-b131-0bc2364a2e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b627e95-4e42-4a2d-bcef-07b153d13a5a', 'volume_name': 'volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2edb03-96fd-4e30-9230-0ee0849905e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2edb03-96fd-4e30-9230-0ee0849905e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c4d2c82-a3e2-48db-ac07-fbdbb908e133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:01 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Volume 5b627e95-4e42-4a2d-bcef-07b153d13a5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a', 'volume_size': 1} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1256128370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b627e95-4e42-4a2d-bcef-07b153d13a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362965b0bc6444dbdab8649130943e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:24:01Z,use_quota=True,user_id='baa248c702ca48cb9dbf2bf1d3305aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Creating volume 5b627e95-4e42-4a2d-bcef-07b153d13a5a {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:24:01 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:24:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:01 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a 1073741824 Jun 02 16:24:01 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:02 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a 1073741824" returned: 0 in 0.999s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:02 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a Jun 02 16:24:02 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:03 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a" returned: 0 in 0.694s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:24:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:24:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c4d2c82-a3e2-48db-ac07-fbdbb908e133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7904a7-2a83-4691-9c37-ac0f1e38add3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:03 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Volume volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a (5b627e95-4e42-4a2d-bcef-07b153d13a5a): created successfully Jun 02 16:24:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7904a7-2a83-4691-9c37-ac0f1e38add3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Flow 'volume_create_manager' (61b593da-b0ce-495e-beec-26be2423a9f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:24:03 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-7a789816-4abc-4c50-9852-01c228d1e04b tempest-VolumesSnapshotTestJSON-1084417838 None] Created volume successfully. Jun 02 16:24:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] Creating offline snapshot 360754d0-58a5-4a40-bb41-ffaf872e3037 of volume 5b627e95-4e42-4a2d-bcef-07b153d13a5a {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:24:03 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91c9d56-4f95-4fe5-8d64-59733fdfbad7]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:24:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:03 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a Jun 02 16:24:03 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:04 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a" returned: 0 in 0.868s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:04 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037 1G Jun 02 16:24:04 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:05 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037 1G" returned: 0 in 1.002s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:05 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037 Jun 02 16:24:05 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:06 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037" returned: 0 in 0.748s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:06 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037 is being set with open permissions: ugo+rw Jun 02 16:24:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:06 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037 Jun 02 16:24:06 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:07 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037" returned: 0 in 0.973s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:07 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.info Jun 02 16:24:07 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:08 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.info" returned: 0 in 0.924s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:08 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.info is being set with open permissions: ugo+rw Jun 02 16:24:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:08 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.info Jun 02 16:24:08 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:08 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.info" returned: 0 in 0.716s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.354s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:24:09 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-6c032252-d3d0-47eb-a37d-5cc1950a8635 tempest-VolumesSnapshotTestJSON-1084417838 None] Create snapshot completed successfully Jun 02 16:24:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-360754d0-58a5-4a40-bb41-ffaf872e3037-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:24:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-360754d0-58a5-4a40-bb41-ffaf872e3037-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:24:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-quobyte-5b627e95-4e42-4a2d-bcef-07b153d13a5a" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:24:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-5b627e95-4e42-4a2d-bcef-07b153d13a5a" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:24:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-quobyte-360754d0-58a5-4a40-bb41-ffaf872e3037" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:24:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-360754d0-58a5-4a40-bb41-ffaf872e3037" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:24:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] Deleting offline snapshot 360754d0-58a5-4a40-bb41-ffaf872e3037 of volume 5b627e95-4e42-4a2d-bcef-07b153d13a5a {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:24:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] snapshot_file for this snap is: volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:24:10 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9213bd90-5a47-47b3-9ea8-7403a2af9ca3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:24:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:10 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037 Jun 02 16:24:10 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:12 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037" returned: 0 in 1.297s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:12 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:24:12 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc727f99-5ec9-4dc7-bf0d-64d139036640]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:24:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:12 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a Jun 02 16:24:12 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:13 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a" returned: 0 in 1.032s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:13 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037 Jun 02 16:24:13 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:14 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037" returned: 0 in 0.979s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:14 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037 Jun 02 16:24:14 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:14 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a.360754d0-58a5-4a40-bb41-ffaf872e3037" returned: 0 in 0.779s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-360754d0-58a5-4a40-bb41-ffaf872e3037" released by "_delete_snapshot" :: held 4.305s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:24:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-5b627e95-4e42-4a2d-bcef-07b153d13a5a" released by "delete_snapshot" :: held 4.357s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:24:15 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] Created reservations ['6935fc27-735d-481f-ac95-66fe04d5672e', 'f6223253-67ff-4517-bafc-d0e16686755c', '0c65aced-9527-4cec-bafa-9da94fe60216', '40aedc4a-5989-402c-a1b3-01976b62d66f'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:24:15 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] Delete snapshot completed successfully. Jun 02 16:24:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2311ca3d-8d3c-4c1a-843e-541e6dfc8ba0 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-360754d0-58a5-4a40-bb41-ffaf872e3037-delete_snapshot" released by "delete_snapshot" :: held 4.634s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:24:16 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:24:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Flow 'volume_create_manager' (434b6124-cfae-4f2a-8eb6-ec1d0cdd5bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:24:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318202c1-e49f-439c-8416-f6f3b3991367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318202c1-e49f-439c-8416-f6f3b3991367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-972568310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6049e1-65f1-4ec0-b78b-5253088ccad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362965b0bc6444dbdab8649130943e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:24:17Z,use_quota=True,user_id='baa248c702ca48cb9dbf2bf1d3305aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f09465d-0227-446d-9026-6ac7c2a3dd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f09465d-0227-446d-9026-6ac7c2a3dd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5832635d-58a5-495b-98ee-82950cc04900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5832635d-58a5-495b-98ee-82950cc04900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be6049e1-65f1-4ec0-b78b-5253088ccad0', 'volume_name': 'volume-be6049e1-65f1-4ec0-b78b-5253088ccad0', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d3d685-93b9-40ce-bdab-ef4e393aae49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d3d685-93b9-40ce-bdab-ef4e393aae49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0082ef70-b309-4f22-b3f9-dc5adbaab0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:17 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Volume be6049e1-65f1-4ec0-b78b-5253088ccad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be6049e1-65f1-4ec0-b78b-5253088ccad0', 'volume_size': 1} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-972568310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6049e1-65f1-4ec0-b78b-5253088ccad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362965b0bc6444dbdab8649130943e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:24:17Z,use_quota=True,user_id='baa248c702ca48cb9dbf2bf1d3305aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Creating volume be6049e1-65f1-4ec0-b78b-5253088ccad0 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:24:17 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:24:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:17 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 1073741824 Jun 02 16:24:17 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:18 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 1073741824" returned: 0 in 1.308s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:18 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 Jun 02 16:24:18 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:19 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0" returned: 0 in 0.810s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] <== create_volume: return (2179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:24:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.183s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:24:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0082ef70-b309-4f22-b3f9-dc5adbaab0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be6049e1-65f1-4ec0-b78b-5253088ccad0', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea057d3-13fb-4bc7-956e-51c12cf04adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:19 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Volume volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 (be6049e1-65f1-4ec0-b78b-5253088ccad0): created successfully Jun 02 16:24:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea057d3-13fb-4bc7-956e-51c12cf04adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Flow 'volume_create_manager' (434b6124-cfae-4f2a-8eb6-ec1d0cdd5bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:24:19 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-83905875-78a4-4230-8b65-eb26abd2f3f1 tempest-VolumesSnapshotTestJSON-1084417838 None] Created volume successfully. Jun 02 16:24:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] Creating offline snapshot 3e8dc4a8-5583-4b94-858e-04e23506fede of volume be6049e1-65f1-4ec0-b78b-5253088ccad0 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:24:21 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cab46e1-193f-4924-ac9c-275944fc05a2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:24:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:21 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 Jun 02 16:24:21 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:22 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0" returned: 0 in 1.170s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:22 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede 1G Jun 02 16:24:22 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:23 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede 1G" returned: 0 in 1.125s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:23 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede Jun 02 16:24:23 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:24 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede" returned: 0 in 0.808s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:24 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede is being set with open permissions: ugo+rw Jun 02 16:24:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:24 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede Jun 02 16:24:24 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:25 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede" returned: 0 in 0.915s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:25 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.info Jun 02 16:24:25 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:25 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.info" returned: 0 in 0.803s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:25 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.info is being set with open permissions: ugo+rw Jun 02 16:24:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:25 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.info Jun 02 16:24:25 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:27 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.info" returned: 0 in 1.269s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.303s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:24:27 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-c5fb2a43-67e3-455b-a7f9-7855720561e4 tempest-VolumesSnapshotTestJSON-1084417838 None] Create snapshot completed successfully Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Flow 'volume_create_manager' (4774b9e7-8109-4818-9085-53a2770d997d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c550d3f-1100-497e-9cf6-5d4b92c91060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c550d3f-1100-497e-9cf6-5d4b92c91060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-911051257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba9300a-82aa-4d90-ad5b-612d7a5a3b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362965b0bc6444dbdab8649130943e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:24:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3e8dc4a8-5583-4b94-858e-04e23506fede,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:24:29Z,use_quota=True,user_id='baa248c702ca48cb9dbf2bf1d3305aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26cc36be-2112-4c76-858d-098ff31ec720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26cc36be-2112-4c76-858d-098ff31ec720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932b2722-355b-424d-9d80-579913870b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932b2722-355b-424d-9d80-579913870b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5ba9300a-82aa-4d90-ad5b-612d7a5a3b44', 'volume_name': 'volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44', 'volume_size': 2, 'snapshot_id': '3e8dc4a8-5583-4b94-858e-04e23506fede'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7be7b7-d72b-4562-bfd4-ac17f87e9846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7be7b7-d72b-4562-bfd4-ac17f87e9846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f11ce2-ae51-4d67-b627-991f5b2d5a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:29 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Volume 5ba9300a-82aa-4d90-ad5b-612d7a5a3b44: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44', 'volume_size': 2, 'snapshot_id': '3e8dc4a8-5583-4b94-858e-04e23506fede'} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-quobyte-3e8dc4a8-5583-4b94-858e-04e23506fede-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44" by "_create_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-3e8dc4a8-5583-4b94-858e-04e23506fede-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Creating volume 5ba9300a-82aa-4d90-ad5b-612d7a5a3b44 from snapshot 3e8dc4a8-5583-4b94-858e-04e23506fede {{(pid=86488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-quobyte-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44" by "_copy_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] snapshot: 3e8dc4a8-5583-4b94-858e-04e23506fede, volume: 5ba9300a-82aa-4d90-ad5b-612d7a5a3b44, {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f46e7a2-4485-42de-917c-e09fb34c8162]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:24:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:29 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede Jun 02 16:24:29 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:30 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede" returned: 0 in 1.299s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:30 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6049e1-65f1-4ec0-b78b-5253088ccad0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:24:30 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 16:24:30 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Creating direct copy from snapshot {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 16:24:30 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bb0521-e67e-4912-8923-552b8fe50d71]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:24:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:30 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 Jun 02 16:24:30 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:31 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0" returned: 0 in 0.835s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:31 devstack cinder-volume[86488]: DEBUG cinder.utils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Path /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44 not found in is_blk_device check {{(pid=86488) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 16:24:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:31 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44 Jun 02 16:24:31 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-f468953e-48bf-4632-83f7-46bc2d34270a req-84a128b1-c786-4528-91cf-5764046ad9d6 tempest-TestStampPattern-1149610376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:37 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44" returned: 0 in 6.029s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:37 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[49381acb-f689-434f-a00a-b26286662839]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:24:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:37 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 Jun 02 16:24:37 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:38 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0" returned: 0 in 0.850s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:38 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Image conversion details: src /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44 {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:24:38 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Converted 1024.00 MB image at 169.81 MB/s Jun 02 16:24:38 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44 is being set with open permissions: ugo+rw Jun 02 16:24:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:38 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44 Jun 02 16:24:38 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:39 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44" returned: 0 in 0.685s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44" released by "_copy_volume_from_snapshot" :: held 9.856s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:24:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-3e8dc4a8-5583-4b94-858e-04e23506fede-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44" released by "_create_volume_from_snapshot" :: held 9.900s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:24:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.918s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:24:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-f468953e-48bf-4632-83f7-46bc2d34270a req-84a128b1-c786-4528-91cf-5764046ad9d6 tempest-TestStampPattern-1149610376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.286s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:39 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a471dc5c-b238-4176-90b4-f2024510be05]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:24:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-f468953e-48bf-4632-83f7-46bc2d34270a req-84a128b1-c786-4528-91cf-5764046ad9d6 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:39 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f11ce2-ae51-4d67-b627-991f5b2d5a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44', 'volume_size': 2, 'snapshot_id': '3e8dc4a8-5583-4b94-858e-04e23506fede'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:39 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4c3da4-70c8-40ce-9ec7-7ed498d7aabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:39 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Volume volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44 (5ba9300a-82aa-4d90-ad5b-612d7a5a3b44): created successfully Jun 02 16:24:39 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4c3da4-70c8-40ce-9ec7-7ed498d7aabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:39 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Flow 'volume_create_manager' (4774b9e7-8109-4818-9085-53a2770d997d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:24:39 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-73ebb693-2bbd-497f-8ffb-16f24ec4d7ff tempest-VolumesSnapshotTestJSON-1084417838 None] Created volume successfully. Jun 02 16:24:39 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 Jun 02 16:24:39 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:39 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-f468953e-48bf-4632-83f7-46bc2d34270a req-84a128b1-c786-4528-91cf-5764046ad9d6 tempest-TestStampPattern-1149610376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78" returned: 0 in 0.749s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-f468953e-48bf-4632-83f7-46bc2d34270a req-84a128b1-c786-4528-91cf-5764046ad9d6 tempest-TestStampPattern-1149610376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.777s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:24:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-f468953e-48bf-4632-83f7-46bc2d34270a req-84a128b1-c786-4528-91cf-5764046ad9d6 tempest-TestStampPattern-1149610376 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-2e73d250-c906-4381-9237-9091b7933b78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9923e9bb-a057-4c91-9340-9e3b02ddc9bf', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:24:40 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-f468953e-48bf-4632-83f7-46bc2d34270a req-84a128b1-c786-4528-91cf-5764046ad9d6 tempest-TestStampPattern-1149610376 None] attachment_update completed successfully. Jun 02 16:24:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:24:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:24:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-quobyte-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:24:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44" acquired by "delete_volume" :: waited 0.016s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:24:40 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a8f2cd-ad06-440c-8505-3f1804e61033]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:24:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:40 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44 Jun 02 16:24:40 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:41 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44" returned: 0 in 0.875s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:41 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44 Jun 02 16:24:41 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:42 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44" returned: 0 in 0.767s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44" released by "delete_volume" :: held 1.701s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] Created reservations ['508f351c-5b01-4394-82b5-28190dc2ff40', '4a62c12e-a497-4341-b2e0-e49a75a16311', '0083821b-56ef-463b-8d72-5b83b703bc39', '592228dd-4b46-46fc-85f3-901a9d99dbe4'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:42 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:24:42 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-3e8dc4a8-5583-4b94-858e-04e23506fede-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-3e8dc4a8-5583-4b94-858e-04e23506fede-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-quobyte-be6049e1-65f1-4ec0-b78b-5253088ccad0" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-be6049e1-65f1-4ec0-b78b-5253088ccad0" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-quobyte-3e8dc4a8-5583-4b94-858e-04e23506fede" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-3e8dc4a8-5583-4b94-858e-04e23506fede" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] Deleting offline snapshot 3e8dc4a8-5583-4b94-858e-04e23506fede of volume be6049e1-65f1-4ec0-b78b-5253088ccad0 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] snapshot_file for this snap is: volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0b67a7-f522-4386-bc0f-dbd31cc87455]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:24:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:43 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede Jun 02 16:24:43 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:43 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.964s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:43 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:24:43 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] Deleted volume successfully. Jun 02 16:24:43 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-196c4a21-b1f5-4111-9513-9ddd6329f0cf tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-5ba9300a-82aa-4d90-ad5b-612d7a5a3b44-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:24:43 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede" returned: 0 in 0.818s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6049e1-65f1-4ec0-b78b-5253088ccad0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:24:43 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5622cde3-9c78-4b1a-9046-6680600b494f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:24:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:43 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 Jun 02 16:24:43 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:44 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0" returned: 0 in 0.769s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:44 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede Jun 02 16:24:44 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:45 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede" returned: 0 in 0.789s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:45 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede Jun 02 16:24:45 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:46 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0.3e8dc4a8-5583-4b94-858e-04e23506fede" returned: 0 in 0.710s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-3e8dc4a8-5583-4b94-858e-04e23506fede" released by "_delete_snapshot" :: held 3.245s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:24:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-be6049e1-65f1-4ec0-b78b-5253088ccad0" released by "delete_snapshot" :: held 3.293s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:24:46 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] Created reservations ['1c83cd52-941c-4e8a-b8fa-534504c2d23e', '88b0b774-6f0f-4951-ab8e-c90ce67fd71e', '306f1028-7637-4ba5-afea-071c7beb7a6c', '4fd274f5-cc3a-409b-9cc8-9f5303b6e70f'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:24:46 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] Delete snapshot completed successfully. Jun 02 16:24:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-953df870-9113-4b9a-aaad-87c876aef485 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-3e8dc4a8-5583-4b94-858e-04e23506fede-delete_snapshot" released by "delete_snapshot" :: held 3.502s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:24:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-be6049e1-65f1-4ec0-b78b-5253088ccad0-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:24:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-be6049e1-65f1-4ec0-b78b-5253088ccad0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:24:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-quobyte-be6049e1-65f1-4ec0-b78b-5253088ccad0" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:24:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-be6049e1-65f1-4ec0-b78b-5253088ccad0" acquired by "delete_volume" :: waited 0.017s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:24:47 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd01030b-6237-4843-855b-b996255b9e69]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:24:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:47 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 Jun 02 16:24:47 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:48 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0" returned: 0 in 0.832s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:48 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0 Jun 02 16:24:48 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:48 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-be6049e1-65f1-4ec0-b78b-5253088ccad0" returned: 0 in 0.649s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-be6049e1-65f1-4ec0-b78b-5253088ccad0" released by "delete_volume" :: held 1.557s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:24:48 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] Created reservations ['2a45ca26-0a7e-414b-a8e9-2a3328a6c1a6', 'cf6f0bab-0c89-47a4-b2e9-0bdb000f5f99', '5c138ad2-e7d6-493e-b821-88538c44d3a9', '81b18120-f0fa-40ad-8cca-fae8397dac46'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:24:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:49 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:24:49 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:24:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:24:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:49 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:24:49 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-76a3ddc9-7936-4dad-a3b0-c068163643d5 req-ec520dde-b298-4902-b87f-89b1d557fe1c tempest-TestServerVolumeAttachmentScenario-324933275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-76a3ddc9-7936-4dad-a3b0-c068163643d5 req-ec520dde-b298-4902-b87f-89b1d557fe1c tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:49 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbbcf8d-efe9-43ba-bab2-b5da35c577db]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:24:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-76a3ddc9-7936-4dad-a3b0-c068163643d5 req-ec520dde-b298-4902-b87f-89b1d557fe1c tempest-TestServerVolumeAttachmentScenario-324933275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aec6be68-97aa-4381-8c52-4a36beca75ee {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:49 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aec6be68-97aa-4381-8c52-4a36beca75ee Jun 02 16:24:49 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:49 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.646s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:49 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:24:49 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] Deleted volume successfully. Jun 02 16:24:49 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-28502c9b-4d8b-4674-be95-bc8bc2bf302a tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-be6049e1-65f1-4ec0-b78b-5253088ccad0-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:24:49 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Flow 'volume_create_manager' (aaed21e4-0c2b-452c-9173-9eee4ba91059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e89d60-5206-4bba-bf39-dfa1da9cabb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e89d60-5206-4bba-bf39-dfa1da9cabb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1100175409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ab44c37-a02d-469e-a993-50b0d644374a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362965b0bc6444dbdab8649130943e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:24:50Z,use_quota=True,user_id='baa248c702ca48cb9dbf2bf1d3305aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48ee1bc-e576-4da9-83b8-eb365b0d2926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48ee1bc-e576-4da9-83b8-eb365b0d2926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db778d7d-746f-4c49-9187-6e38b34aaa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db778d7d-746f-4c49-9187-6e38b34aaa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ab44c37-a02d-469e-a993-50b0d644374a', 'volume_name': 'volume-6ab44c37-a02d-469e-a993-50b0d644374a', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240f241b-4eb5-4e58-9ac8-278ec3097012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240f241b-4eb5-4e58-9ac8-278ec3097012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8affe1d2-438d-4a77-ba01-314eb6d3ab8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:50 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Volume 6ab44c37-a02d-469e-a993-50b0d644374a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ab44c37-a02d-469e-a993-50b0d644374a', 'volume_size': 1} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:50 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-016caefa-f10c-4497-bc28-72402efa7b41 req-f285c30f-cc1c-4a70-a786-2918033ef64a tempest-TestStampPattern-1149610376 None] Terminate volume connection completed successfully. Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-016caefa-f10c-4497-bc28-72402efa7b41 req-f285c30f-cc1c-4a70-a786-2918033ef64a tempest-TestStampPattern-1149610376 None] Deleting attachment 9923e9bb-a057-4c91-9340-9e3b02ddc9bf. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:24:50 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-76a3ddc9-7936-4dad-a3b0-c068163643d5 req-ec520dde-b298-4902-b87f-89b1d557fe1c tempest-TestServerVolumeAttachmentScenario-324933275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aec6be68-97aa-4381-8c52-4a36beca75ee" returned: 0 in 0.819s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-76a3ddc9-7936-4dad-a3b0-c068163643d5 req-ec520dde-b298-4902-b87f-89b1d557fe1c tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.843s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.118s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1100175409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ab44c37-a02d-469e-a993-50b0d644374a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362965b0bc6444dbdab8649130943e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:24:50Z,use_quota=True,user_id='baa248c702ca48cb9dbf2bf1d3305aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Creating volume 6ab44c37-a02d-469e-a993-50b0d644374a {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:24:50 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:50 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a 1073741824 Jun 02 16:24:50 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-76a3ddc9-7936-4dad-a3b0-c068163643d5 req-ec520dde-b298-4902-b87f-89b1d557fe1c tempest-TestServerVolumeAttachmentScenario-324933275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-aec6be68-97aa-4381-8c52-4a36beca75ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d5f45be-3082-4415-987f-21130c0fc1cd', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:24:50 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-76a3ddc9-7936-4dad-a3b0-c068163643d5 req-ec520dde-b298-4902-b87f-89b1d557fe1c tempest-TestServerVolumeAttachmentScenario-324933275 None] attachment_update completed successfully. Jun 02 16:24:51 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a 1073741824" returned: 0 in 0.834s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:51 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a Jun 02 16:24:51 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:51 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a" returned: 0 in 0.668s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:24:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:24:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8affe1d2-438d-4a77-ba01-314eb6d3ab8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ab44c37-a02d-469e-a993-50b0d644374a', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba0790f-b866-4b6d-8e1d-33ca6aa3114d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:24:51 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Volume volume-6ab44c37-a02d-469e-a993-50b0d644374a (6ab44c37-a02d-469e-a993-50b0d644374a): created successfully Jun 02 16:24:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba0790f-b866-4b6d-8e1d-33ca6aa3114d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:24:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Flow 'volume_create_manager' (aaed21e4-0c2b-452c-9173-9eee4ba91059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:24:51 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-738558ae-2207-4f12-bc39-fb24576787d9 tempest-VolumesSnapshotTestJSON-1084417838 None] Created volume successfully. Jun 02 16:24:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:52 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] Creating offline snapshot 14cbd723-94c3-4409-b0de-7c8c73fc26e2 of volume 2e73d250-c906-4381-9237-9091b7933b78 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:24:52 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44c44b3-128d-49cd-b6da-6eaa421f3ff5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:24:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:52 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 Jun 02 16:24:52 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:24:52 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78" returned: 0 in 0.901s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:52 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2 1G Jun 02 16:24:52 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:53 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2 1G" returned: 0 in 0.857s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e73d250-c906-4381-9237-9091b7933b78 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:53 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e73d250-c906-4381-9237-9091b7933b78 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2 Jun 02 16:24:53 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:54 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e73d250-c906-4381-9237-9091b7933b78 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2" returned: 0 in 0.809s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:54 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2 is being set with open permissions: ugo+rw Jun 02 16:24:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:54 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2 Jun 02 16:24:54 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:55 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2" returned: 0 in 0.630s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:55 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.info Jun 02 16:24:55 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:55 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.info" returned: 0 in 0.700s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:55 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.info is being set with open permissions: ugo+rw Jun 02 16:24:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:56 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.info Jun 02 16:24:56 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:56 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.info" returned: 0 in 0.606s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.620s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:24:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.155s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:24:56 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] Creating offline snapshot 6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f of volume 6ab44c37-a02d-469e-a993-50b0d644374a {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:24:56 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e6416c-2127-422d-9591-87a9dd81208b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:24:56 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-d44cae3f-a1bc-47d1-ab21-cca85f3fbf49 tempest-TestStampPattern-1149610376 None] Create snapshot completed successfully Jun 02 16:24:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:56 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a Jun 02 16:24:56 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:57 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a" returned: 0 in 0.805s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:57 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f 1G Jun 02 16:24:57 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:58 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f 1G" returned: 0 in 0.859s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ab44c37-a02d-469e-a993-50b0d644374a -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:58 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ab44c37-a02d-469e-a993-50b0d644374a -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f Jun 02 16:24:58 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:24:59 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Jun 02 16:24:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ab44c37-a02d-469e-a993-50b0d644374a -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f" returned: 0 in 1.044s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:24:59 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f is being set with open permissions: ugo+rw Jun 02 16:24:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:24:59 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f Jun 02 16:24:59 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:25:00 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:25:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:25:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f" returned: 0 in 0.723s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:00 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:25:00 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:00 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.info Jun 02 16:25:00 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-50dd4c22-2a5a-4b43-9114-d48924f4642e req-07a5b780-b863-44d6-8e5c-c702b16d485c tempest-TestServerVolumeAttachmentScenario-324933275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:01 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.info" returned: 0 in 1.007s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:01 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.info is being set with open permissions: ugo+rw Jun 02 16:25:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:01 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.info Jun 02 16:25:01 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:01 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.180s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:01 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:25:01 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.info" returned: 0 in 0.807s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.364s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-50dd4c22-2a5a-4b43-9114-d48924f4642e req-07a5b780-b863-44d6-8e5c-c702b16d485c tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.950s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:02 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=66,cinder:UPDATE=46,cinder:DELETE=3,cinder:INSERT=11 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:25:02 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=59,cinder:UPDATE=49,cinder:INSERT=12,cinder:DELETE=6 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:25:02 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd6f4e8-77ff-4927-98c4-b867fbc323ea]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-50dd4c22-2a5a-4b43-9114-d48924f4642e req-07a5b780-b863-44d6-8e5c-c702b16d485c tempest-TestServerVolumeAttachmentScenario-324933275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:02 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-602aafab-8b4a-497e-84eb-f7fca92293b3 tempest-VolumesSnapshotTestJSON-1084417838 None] Create snapshot completed successfully Jun 02 16:25:02 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8 Jun 02 16:25:02 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:03 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-50dd4c22-2a5a-4b43-9114-d48924f4642e req-07a5b780-b863-44d6-8e5c-c702b16d485c tempest-TestServerVolumeAttachmentScenario-324933275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8" returned: 0 in 0.976s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-50dd4c22-2a5a-4b43-9114-d48924f4642e req-07a5b780-b863-44d6-8e5c-c702b16d485c tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.013s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-50dd4c22-2a5a-4b43-9114-d48924f4642e req-07a5b780-b863-44d6-8e5c-c702b16d485c tempest-TestServerVolumeAttachmentScenario-324933275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97f4425e-432b-48fa-802d-3f4c6cfdcb04', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:25:03 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-50dd4c22-2a5a-4b43-9114-d48924f4642e req-07a5b780-b863-44d6-8e5c-c702b16d485c tempest-TestServerVolumeAttachmentScenario-324933275 None] attachment_update completed successfully. Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Flow 'volume_create_manager' (2d8d8039-a82b-4435-aa14-34b523a57d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b17bb1-cecd-4608-9476-5db4a953cadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b17bb1-cecd-4608-9476-5db4a953cadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1680863978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362965b0bc6444dbdab8649130943e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:25:04Z,use_quota=True,user_id='baa248c702ca48cb9dbf2bf1d3305aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639cf0e8-446e-4404-b4c5-3b3014a4a9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639cf0e8-446e-4404-b4c5-3b3014a4a9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8348999d-b057-44a1-bf18-a716954e0894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8348999d-b057-44a1-bf18-a716954e0894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5', 'volume_name': 'volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5', 'volume_size': 1, 'snapshot_id': '6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc4a853-4ab8-4849-b9b1-b0ab803104d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc4a853-4ab8-4849-b9b1-b0ab803104d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9071956c-077b-4301-9124-8695edde386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:03 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Volume ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5', 'volume_size': 1, 'snapshot_id': '6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f'} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-quobyte-6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5" by "_create_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Creating volume ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5 from snapshot 6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f {{(pid=86488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-quobyte-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5" by "_copy_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] snapshot: 6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f, volume: ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5, {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1810a50f-a20e-4e43-90d7-6b1fa9246ac1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:04 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f Jun 02 16:25:04 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Flow 'volume_create_manager' (5854b4bd-7ed3-4c79-980c-ef53f56945bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3482de4-6c81-45cc-b370-7f57f5297183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3482de4-6c81-45cc-b370-7f57f5297183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1851334076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7af30eb-04af-4de3-b34f-8cd84c5a53b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a27f93fa29af4748b2a7aeef0463babf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:25:04Z,use_quota=True,user_id='e49ee15626b840afa14e0faa1d079a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb14cca-48d2-422e-8246-9087532e4eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb14cca-48d2-422e-8246-9087532e4eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec6ce97-bfc3-4cbe-92d2-2b6e20a9ce20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec6ce97-bfc3-4cbe-92d2-2b6e20a9ce20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7af30eb-04af-4de3-b34f-8cd84c5a53b5', 'volume_name': 'volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06794836-66ca-4718-982b-ea318c95d622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06794836-66ca-4718-982b-ea318c95d622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd17bdb2-bdbf-482f-a752-69d60bb499be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:04 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Volume d7af30eb-04af-4de3-b34f-8cd84c5a53b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5', 'volume_size': 1} Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:04 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f" returned: 0 in 0.917s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ab44c37-a02d-469e-a993-50b0d644374a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Creating direct copy from snapshot {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4ea760-31da-451b-b225-85be57c3d63e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:04 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a Jun 02 16:25:04 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:05 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a" returned: 0 in 0.827s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:05 devstack cinder-volume[86488]: DEBUG cinder.utils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Path /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5 not found in is_blk_device check {{(pid=86488) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 16:25:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:05 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5 Jun 02 16:25:05 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:11 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:25:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Flow 'volume_create_manager' (53324011-1898-4b75-8c22-a1527fbc0b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:25:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba09071-ec82-4379-bcff-35418995b1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba09071-ec82-4379-bcff-35418995b1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-353429467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3324bc01784ab187313f0787000a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=14cbd723-94c3-4409-b0de-7c8c73fc26e2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:25:11Z,use_quota=True,user_id='b8593bf057a64ea8a27ddfdd08862a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7654deae-1dcd-47db-974c-e7a3230b53bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7654deae-1dcd-47db-974c-e7a3230b53bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9e1e24-c671-447f-80fc-4eef4dfe487a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9e1e24-c671-447f-80fc-4eef4dfe487a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d', 'volume_name': 'volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d', 'volume_size': 1, 'snapshot_id': '14cbd723-94c3-4409-b0de-7c8c73fc26e2'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2eaadc-d63f-47f2-93ea-471f7b281981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2eaadc-d63f-47f2-93ea-471f7b281981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a718ce-6c79-4ae1-9e50-6611c0e4ca80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:11 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Volume c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d', 'volume_size': 1, 'snapshot_id': '14cbd723-94c3-4409-b0de-7c8c73fc26e2'} Jun 02 16:25:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:11 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-9cf3ce98-86ee-4938-aacb-0cc1c0a2a1c3 req-933a233b-9466-4fca-8750-e23a520226a1 tempest-TestServerVolumeAttachmentScenario-324933275 None] Terminate volume connection completed successfully. Jun 02 16:25:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-9cf3ce98-86ee-4938-aacb-0cc1c0a2a1c3 req-933a233b-9466-4fca-8750-e23a520226a1 tempest-TestServerVolumeAttachmentScenario-324933275 None] Deleting attachment 97f4425e-432b-48fa-802d-3f4c6cfdcb04. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:25:13 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5" returned: 0 in 7.684s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:13 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16c12a0-728e-45e6-b3a5-081e6a2d85e7]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:13 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a Jun 02 16:25:13 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:14 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a" returned: 0 in 0.921s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:14 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Image conversion details: src /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a, size 1024.00 MB, duration 7.68 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5 {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:25:14 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Converted 1024.00 MB image at 133.25 MB/s Jun 02 16:25:14 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5 is being set with open permissions: ugo+rw Jun 02 16:25:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:14 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5 Jun 02 16:25:14 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:14 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5" returned: 0 in 0.610s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5" released by "_copy_volume_from_snapshot" :: held 11.081s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:25:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5" released by "_create_volume_from_snapshot" :: held 11.121s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:25:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.140s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.452s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1851334076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7af30eb-04af-4de3-b34f-8cd84c5a53b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a27f93fa29af4748b2a7aeef0463babf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:25:04Z,use_quota=True,user_id='e49ee15626b840afa14e0faa1d079a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:25:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Creating volume d7af30eb-04af-4de3-b34f-8cd84c5a53b5 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:25:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:25:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:25:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:25:14 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:25:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:14 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5 1073741824 Jun 02 16:25:14 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:15 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9071956c-077b-4301-9124-8695edde386b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5', 'volume_size': 1, 'snapshot_id': '6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:15 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6708280a-1364-4583-8212-89527b1b5bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:15 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Volume volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5 (ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5): created successfully Jun 02 16:25:15 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6708280a-1364-4583-8212-89527b1b5bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:15 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Flow 'volume_create_manager' (2d8d8039-a82b-4435-aa14-34b523a57d3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:25:15 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-a692dc04-6429-4335-b9d1-a4f6dc4f7634 tempest-VolumesSnapshotTestJSON-1084417838 None] Created volume successfully. Jun 02 16:25:15 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-14e9b72e-0002-4441-bce7-89015ef2422d req-def24795-cf98-4cbf-8ddf-32df85e9e317 tempest-TestServerVolumeAttachmentScenario-324933275 None] Terminate volume connection completed successfully. Jun 02 16:25:15 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-14e9b72e-0002-4441-bce7-89015ef2422d req-def24795-cf98-4cbf-8ddf-32df85e9e317 tempest-TestServerVolumeAttachmentScenario-324933275 None] Deleting attachment 7d5f45be-3082-4415-987f-21130c0fc1cd. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:25:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:25:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:25:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-quobyte-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:25:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5" acquired by "delete_volume" :: waited 0.017s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:25:15 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b1832b-645c-4e22-94f7-86abfa93a13b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:15 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5 Jun 02 16:25:15 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:15 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5 1073741824" returned: 0 in 0.934s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:15 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5 Jun 02 16:25:15 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:16 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5" returned: 0 in 0.741s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:16 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5 Jun 02 16:25:16 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:16 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5" returned: 0 in 0.651s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.023s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Acquiring lock "cinder-quobyte-14cbd723-94c3-4409-b0de-7c8c73fc26e2-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d" by "_create_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd17bdb2-bdbf-482f-a752-69d60bb499be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb34ac5b-0b5e-4329-a8e1-09a1acafe4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Lock "cinder-quobyte-14cbd723-94c3-4409-b0de-7c8c73fc26e2-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Creating volume c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d from snapshot 14cbd723-94c3-4409-b0de-7c8c73fc26e2 {{(pid=86488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Acquiring lock "cinder-quobyte-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d" by "_copy_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:25:16 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Volume volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5 (d7af30eb-04af-4de3-b34f-8cd84c5a53b5): created successfully Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb34ac5b-0b5e-4329-a8e1-09a1acafe4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Flow 'volume_create_manager' (5854b4bd-7ed3-4c79-980c-ef53f56945bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Lock "cinder-quobyte-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] snapshot: 14cbd723-94c3-4409-b0de-7c8c73fc26e2, volume: c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d, {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 16:25:16 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-df04078e-89e9-4d51-ab88-3e55d6c66458 tempest-TestMinimumBasicScenario-918015095 None] Created volume successfully. Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf2f57e-ff50-4866-b010-206ebed7f68f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:16 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2 Jun 02 16:25:16 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:17 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5" returned: 0 in 0.740s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5" released by "delete_volume" :: held 1.541s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] Created reservations ['4a1876e7-7127-4aa0-97e7-77063ded7e1d', '16b848b2-79aa-46f5-bb26-76bb8ec61cce', 'a5015a4d-216d-4fbb-9cab-6417b18fee88', 'bfe788ef-b371-4ceb-978b-95b4c5ee4de0'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:17 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:25:17 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:17 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2" returned: 0 in 0.980s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e73d250-c906-4381-9237-9091b7933b78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Creating direct copy from snapshot {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cece363-80f9-43f9-ad29-3f7bbe554fc2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-quobyte-6ab44c37-a02d-469e-a993-50b0d644374a" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-6ab44c37-a02d-469e-a993-50b0d644374a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-quobyte-6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] Deleting offline snapshot 6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f of volume 6ab44c37-a02d-469e-a993-50b0d644374a {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] snapshot_file for this snap is: volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:25:17 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 Jun 02 16:25:17 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf584ab-acd1-4ebd-ae12-45be75437a91]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:18 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.746s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:18 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:25:18 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] Deleted volume successfully. Jun 02 16:25:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-46e546e1-0e1e-4032-8cf7-11795295fc0c tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-ab5be3aa-cfc7-4455-9a75-0e0bb43c38e5-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:25:18 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f Jun 02 16:25:18 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:19 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78" returned: 0 in 1.310s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:19 devstack cinder-volume[86488]: DEBUG cinder.utils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Path /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d not found in is_blk_device check {{(pid=86488) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 16:25:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:19 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d Jun 02 16:25:19 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:19 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f" returned: 0 in 1.324s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ab44c37-a02d-469e-a993-50b0d644374a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:25:19 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aff22cd-3645-45fb-b8b9-a0b8f2fdcb9e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:19 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a Jun 02 16:25:19 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:20 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a" returned: 0 in 1.376s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:20 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f Jun 02 16:25:20 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-2bbf3ea3-cab9-4d9b-9ab5-2eea1f6f41f8 req-1e12fa0d-4cd7-4291-a32a-25871a63a4b5 tempest-TestMinimumBasicScenario-918015095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:23 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f" returned: 0 in 2.278s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:23 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f Jun 02 16:25:23 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:25 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a.6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f" returned: 0 in 2.035s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f" released by "_delete_snapshot" :: held 7.336s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:25:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-6ab44c37-a02d-469e-a993-50b0d644374a" released by "delete_snapshot" :: held 7.374s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:25:25 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] Created reservations ['1d2208ca-d1d0-463c-9b38-88b445a3ef3a', 'e7063d23-6bed-48c4-a74c-de67fe73ec5a', '88864a57-a12a-4d0d-8895-d2877731704e', '5764fbb8-ad20-4132-9b7a-e9012d5cd16e'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:25:25 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] Delete snapshot completed successfully. Jun 02 16:25:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4be912fc-347f-4d88-9b45-491f503b7472 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-6ea9d601-6a7b-46a1-a66f-a7ff26c72e5f-delete_snapshot" released by "delete_snapshot" :: held 7.848s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:25:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-6ab44c37-a02d-469e-a993-50b0d644374a-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:25:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-6ab44c37-a02d-469e-a993-50b0d644374a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:25:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-quobyte-6ab44c37-a02d-469e-a993-50b0d644374a" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:25:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-6ab44c37-a02d-469e-a993-50b0d644374a" acquired by "delete_volume" :: waited 0.057s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:25:26 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b720db77-e298-44b0-9c02-94577a8c0d77]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:27 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a Jun 02 16:25:27 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:27 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d" returned: 0 in 8.279s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:27 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[550fc8e3-a0ba-47aa-99fe-7f299b2bd740]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:27 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 Jun 02 16:25:27 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:27 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a" returned: 0 in 1.421s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:28 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a Jun 02 16:25:28 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:28 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78" returned: 0 in 1.162s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:28 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Image conversion details: src /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78, size 1024.00 MB, duration 8.28 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:25:28 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Converted 1024.00 MB image at 123.66 MB/s Jun 02 16:25:28 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d is being set with open permissions: ugo+rw Jun 02 16:25:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:28 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d Jun 02 16:25:28 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] Acquiring lock "cinder-49f5e802-8239-4ba5-9660-c9e6d109cbf8-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:25:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "cinder-49f5e802-8239-4ba5-9660-c9e6d109cbf8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:25:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] Acquiring lock "cinder-quobyte-49f5e802-8239-4ba5-9660-c9e6d109cbf8" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:25:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "cinder-quobyte-49f5e802-8239-4ba5-9660-c9e6d109cbf8" acquired by "delete_volume" :: waited 0.025s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:25:28 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1c8223-0f9e-48a0-b34c-b6446e39f7f6]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:28 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6ab44c37-a02d-469e-a993-50b0d644374a" returned: 0 in 0.898s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-6ab44c37-a02d-469e-a993-50b0d644374a" released by "delete_volume" :: held 2.477s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:25:28 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] Created reservations ['ebec3cff-fd0e-41d7-b8d7-2dd363a659ac', '3f411299-24ca-489e-b0eb-cabccbde8234', '511b6941-c23a-4ff2-b15b-acfdab9c4247', '0c5cbe8c-68ad-4420-a184-bbb8ede1e4ec'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:25:28 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8 Jun 02 16:25:28 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:29 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:25:29 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:29 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d" returned: 0 in 0.711s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Lock "cinder-quobyte-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d" released by "_copy_volume_from_snapshot" :: held 12.599s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Lock "cinder-quobyte-14cbd723-94c3-4409-b0de-7c8c73fc26e2-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d" released by "_create_volume_from_snapshot" :: held 12.659s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.706s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-2bbf3ea3-cab9-4d9b-9ab5-2eea1f6f41f8 req-1e12fa0d-4cd7-4291-a32a-25871a63a4b5 tempest-TestMinimumBasicScenario-918015095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.337s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[39eb5351-136c-40a6-80bf-c6475ce84033]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-2bbf3ea3-cab9-4d9b-9ab5-2eea1f6f41f8 req-1e12fa0d-4cd7-4291-a32a-25871a63a4b5 tempest-TestMinimumBasicScenario-918015095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a718ce-6c79-4ae1-9e50-6611c0e4ca80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d', 'volume_size': 1, 'snapshot_id': '14cbd723-94c3-4409-b0de-7c8c73fc26e2'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7fb318c-570d-4dff-9038-afa237f09a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:29 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Volume volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d (c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d): created successfully Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7fb318c-570d-4dff-9038-afa237f09a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Flow 'volume_create_manager' (53324011-1898-4b75-8c22-a1527fbc0b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:25:29 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-42abbe5b-e358-470b-875c-9f62247413b8 tempest-TestStampPattern-1149610376 None] Created volume successfully. Jun 02 16:25:29 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5 Jun 02 16:25:29 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:29 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8" returned: 0 in 1.006s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:29 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8 Jun 02 16:25:29 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:30 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-5b627e95-4e42-4a2d-bcef-07b153d13a5a-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:25:30 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-5b627e95-4e42-4a2d-bcef-07b153d13a5a-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:25:30 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.243s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:30 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:25:30 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] Deleted volume successfully. Jun 02 16:25:30 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "cinder-quobyte-5b627e95-4e42-4a2d-bcef-07b153d13a5a" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:25:30 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8e629fae-ac3e-459a-a4dd-9a8de9fb8bd7 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-6ab44c37-a02d-469e-a993-50b0d644374a-delete_volume" released by "delete_volume" :: held 4.071s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:25:30 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-5b627e95-4e42-4a2d-bcef-07b153d13a5a" acquired by "delete_volume" :: waited 0.048s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:25:30 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ba716e-0ed2-4bb8-ab00-91de7694e521]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:30 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-2bbf3ea3-cab9-4d9b-9ab5-2eea1f6f41f8 req-1e12fa0d-4cd7-4291-a32a-25871a63a4b5 tempest-TestMinimumBasicScenario-918015095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5" returned: 0 in 1.209s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-2bbf3ea3-cab9-4d9b-9ab5-2eea1f6f41f8 req-1e12fa0d-4cd7-4291-a32a-25871a63a4b5 tempest-TestMinimumBasicScenario-918015095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.249s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-2bbf3ea3-cab9-4d9b-9ab5-2eea1f6f41f8 req-1e12fa0d-4cd7-4291-a32a-25871a63a4b5 tempest-TestMinimumBasicScenario-918015095 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a252600-eefc-449e-ab55-76184170f769', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:25:30 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a Jun 02 16:25:30 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:30 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-2bbf3ea3-cab9-4d9b-9ab5-2eea1f6f41f8 req-1e12fa0d-4cd7-4291-a32a-25871a63a4b5 tempest-TestMinimumBasicScenario-918015095 None] attachment_update completed successfully. Jun 02 16:25:31 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-49f5e802-8239-4ba5-9660-c9e6d109cbf8" returned: 0 in 1.276s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "cinder-quobyte-49f5e802-8239-4ba5-9660-c9e6d109cbf8" released by "delete_volume" :: held 2.354s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:25:31 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] Created reservations ['46b314b1-a5c0-43b1-aa79-f9b90f9be282', 'f84a9959-964c-4ee6-bf79-5daaf8b6c11a', '14d5b47d-1c76-472f-a1ad-3d477994569a', 'eadc8ea6-549c-455c-afbe-5030bede4dce'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:25:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:25:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:25:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:31 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:25:31 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:31 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a" returned: 0 in 1.326s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:31 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a Jun 02 16:25:31 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:32 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.709s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:25:32 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] Deleted volume successfully. Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9f61d4ed-ef92-436c-840d-443fcd94c952 tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "cinder-49f5e802-8239-4ba5-9660-c9e6d109cbf8-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] Acquiring lock "cinder-aec6be68-97aa-4381-8c52-4a36beca75ee-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "cinder-aec6be68-97aa-4381-8c52-4a36beca75ee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] Acquiring lock "cinder-quobyte-aec6be68-97aa-4381-8c52-4a36beca75ee" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "cinder-quobyte-aec6be68-97aa-4381-8c52-4a36beca75ee" acquired by "delete_volume" :: waited 0.021s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a7e95a-9ec4-4c1f-84ee-884e4915fe10]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aec6be68-97aa-4381-8c52-4a36beca75ee {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:32 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aec6be68-97aa-4381-8c52-4a36beca75ee Jun 02 16:25:32 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:32 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b627e95-4e42-4a2d-bcef-07b153d13a5a" returned: 0 in 0.839s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-quobyte-5b627e95-4e42-4a2d-bcef-07b153d13a5a" released by "delete_volume" :: held 2.290s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] Created reservations ['27595c8e-70ab-49b0-beb9-1acbcdfce58c', '1fc7f21c-d554-41bf-9f3f-9aa21411b03c', 'ebb98486-6718-4b79-8611-3d9705549204', 'eb613e48-b60c-4fb9-8244-112780f61005'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:32 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:25:32 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:33 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aec6be68-97aa-4381-8c52-4a36beca75ee" returned: 0 in 0.928s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aec6be68-97aa-4381-8c52-4a36beca75ee {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:33 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aec6be68-97aa-4381-8c52-4a36beca75ee Jun 02 16:25:33 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:33 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.844s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:33 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:25:33 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] Deleted volume successfully. Jun 02 16:25:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cdcb0952-145c-4796-a862-c39d2529e853 tempest-VolumesSnapshotTestJSON-1084417838 None] Lock "cinder-5b627e95-4e42-4a2d-bcef-07b153d13a5a-delete_volume" released by "delete_volume" :: held 3.525s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:25:34 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-aec6be68-97aa-4381-8c52-4a36beca75ee" returned: 0 in 0.800s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "cinder-quobyte-aec6be68-97aa-4381-8c52-4a36beca75ee" released by "delete_volume" :: held 1.791s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:25:34 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] Created reservations ['3ce7934c-b210-42b9-a2b7-4de30b8ce34c', '40e56f80-5a63-45bf-9dc6-2174bc03f7f5', '0519cb28-0476-439b-a5db-f84574df5bd7', 'fab04967-1151-45b2-a054-140d20fc74e0'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:25:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:25:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:25:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:34 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:25:34 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:35 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.072s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:35 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:25:35 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] Deleted volume successfully. Jun 02 16:25:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-47e6064f-63d1-44cb-a070-27674a17d3c7 tempest-TestServerVolumeAttachmentScenario-324933275 None] Lock "cinder-aec6be68-97aa-4381-8c52-4a36beca75ee-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Flow 'volume_create_manager' (3b056f62-5916-429c-8d44-ff1f9ab09f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa909661-06fe-4abe-baec-a734eb3d82c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa909661-06fe-4abe-baec-a734eb3d82c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1798419147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85c6484-715f-4086-b95f-7a7971ab764d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5a994ba6c0458bb1becd526f6da20f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:25:43Z,use_quota=True,user_id='d59f5469ac3d488d9c9105b684860917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c928fc48-50b5-40db-9a6f-8b947117874d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c928fc48-50b5-40db-9a6f-8b947117874d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458a6ce1-4c6f-412c-adfa-9ecff5cbae25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458a6ce1-4c6f-412c-adfa-9ecff5cbae25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f85c6484-715f-4086-b95f-7a7971ab764d', 'volume_name': 'volume-f85c6484-715f-4086-b95f-7a7971ab764d', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bec4d6-b3d0-4fbb-b68c-21fcb4dc0e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bec4d6-b3d0-4fbb-b68c-21fcb4dc0e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101bbeb9-e931-441c-bc6a-261cf8453768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:43 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Volume f85c6484-715f-4086-b95f-7a7971ab764d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f85c6484-715f-4086-b95f-7a7971ab764d', 'volume_size': 1} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1798419147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85c6484-715f-4086-b95f-7a7971ab764d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5a994ba6c0458bb1becd526f6da20f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:25:43Z,use_quota=True,user_id='d59f5469ac3d488d9c9105b684860917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Creating volume f85c6484-715f-4086-b95f-7a7971ab764d {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:25:43 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:25:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:43 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d 1073741824 Jun 02 16:25:43 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:44 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d 1073741824" returned: 0 in 0.980s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:44 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d Jun 02 16:25:44 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:45 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d" returned: 0 in 0.691s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:25:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101bbeb9-e931-441c-bc6a-261cf8453768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f85c6484-715f-4086-b95f-7a7971ab764d', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26f3549-e0bb-4b25-b380-e7f8efb623f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:45 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Volume volume-f85c6484-715f-4086-b95f-7a7971ab764d (f85c6484-715f-4086-b95f-7a7971ab764d): created successfully Jun 02 16:25:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26f3549-e0bb-4b25-b380-e7f8efb623f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:45 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Flow 'volume_create_manager' (3b056f62-5916-429c-8d44-ff1f9ab09f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:25:45 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f8d64253-2107-4b57-a091-bbc7bb2945ff tempest-VolumesSnapshotListTestJSON-123257052 None] Created volume successfully. Jun 02 16:25:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] Creating offline snapshot 015caa7a-ab7a-44a3-9cb9-c436e09a5a7a of volume f85c6484-715f-4086-b95f-7a7971ab764d {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:25:46 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[714c9c67-8315-49cb-ade8-8830ea22b2f5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:47 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d Jun 02 16:25:47 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:47 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d" returned: 0 in 0.919s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:47 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a 1G Jun 02 16:25:47 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:48 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a 1G" returned: 0 in 0.867s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f85c6484-715f-4086-b95f-7a7971ab764d -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:48 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f85c6484-715f-4086-b95f-7a7971ab764d -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a Jun 02 16:25:48 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:49 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f85c6484-715f-4086-b95f-7a7971ab764d -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a" returned: 0 in 0.793s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:49 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a is being set with open permissions: ugo+rw Jun 02 16:25:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:49 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a Jun 02 16:25:49 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:50 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a" returned: 0 in 0.651s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:50 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.info Jun 02 16:25:50 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:50 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:25:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Flow 'volume_create_manager' (bcd92964-4549-4c7f-8b2f-21c7d4c2c7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:25:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b5341e-cecb-4318-a7e6-a6d52c53e7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b5341e-cecb-4318-a7e6-a6d52c53e7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0871fe59-6481-41b3-8676-7211c45e84fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a230dc4fab9b450e9123462cabc5a8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:25:50Z,use_quota=True,user_id='61190807f8134243bd6e6c43043c01ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b24bd16-b93f-4ef3-a5cc-e99b5b50bb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b24bd16-b93f-4ef3-a5cc-e99b5b50bb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be939c5b-3f58-4abc-9b16-5c27d48059ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be939c5b-3f58-4abc-9b16-5c27d48059ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0871fe59-6481-41b3-8676-7211c45e84fc', 'volume_name': 'volume-0871fe59-6481-41b3-8676-7211c45e84fc', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2fb04f-dfaf-4951-b396-858016c0ae72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2fb04f-dfaf-4951-b396-858016c0ae72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51fc6f4d-863f-4bf3-8cdc-a01fa58e0c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:50 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Volume 0871fe59-6481-41b3-8676-7211c45e84fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0871fe59-6481-41b3-8676-7211c45e84fc', 'volume_size': 1} Jun 02 16:25:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:50 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.info" returned: 0 in 0.703s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:50 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.info is being set with open permissions: ugo+rw Jun 02 16:25:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:50 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.info Jun 02 16:25:50 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:51 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.info" returned: 0 in 0.641s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.679s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.095s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0871fe59-6481-41b3-8676-7211c45e84fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a230dc4fab9b450e9123462cabc5a8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:25:50Z,use_quota=True,user_id='61190807f8134243bd6e6c43043c01ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:25:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Creating volume 0871fe59-6481-41b3-8676-7211c45e84fc {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:25:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:25:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:25:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:51 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:25:51 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:25:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0871fe59-6481-41b3-8676-7211c45e84fc 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:51 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0871fe59-6481-41b3-8676-7211c45e84fc 1073741824 Jun 02 16:25:51 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:51 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-8b56d15c-c2f6-4831-a160-34acd77466a7 tempest-VolumesSnapshotListTestJSON-123257052 None] Create snapshot completed successfully Jun 02 16:25:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ef85a1c6-cb53-48cd-86a1-cc6904b1e995 tempest-VolumesSnapshotListTestJSON-123257052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:52 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0871fe59-6481-41b3-8676-7211c45e84fc 1073741824" returned: 0 in 0.911s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0871fe59-6481-41b3-8676-7211c45e84fc {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:52 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0871fe59-6481-41b3-8676-7211c45e84fc Jun 02 16:25:52 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:53 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0871fe59-6481-41b3-8676-7211c45e84fc" returned: 0 in 0.619s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:25:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ef85a1c6-cb53-48cd-86a1-cc6904b1e995 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.842s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51fc6f4d-863f-4bf3-8cdc-a01fa58e0c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0871fe59-6481-41b3-8676-7211c45e84fc', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5c2930-0842-4979-bcdf-6d6fdabb770a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-ef85a1c6-cb53-48cd-86a1-cc6904b1e995 tempest-VolumesSnapshotListTestJSON-123257052 None] Creating offline snapshot 28b0085b-cd98-4173-b028-9e133cf167eb of volume f85c6484-715f-4086-b95f-7a7971ab764d {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:25:53 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Volume volume-0871fe59-6481-41b3-8676-7211c45e84fc (0871fe59-6481-41b3-8676-7211c45e84fc): created successfully Jun 02 16:25:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5c2930-0842-4979-bcdf-6d6fdabb770a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Flow 'volume_create_manager' (bcd92964-4549-4c7f-8b2f-21c7d4c2c7c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:25:53 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe689b44-8747-42da-b825-36aea977b093]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ef85a1c6-cb53-48cd-86a1-cc6904b1e995 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:53 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-96a3436d-2cd4-47c6-845a-c28dcf55f249 tempest-CinderUnicodeTest-536117729 None] Created volume successfully. Jun 02 16:25:53 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a Jun 02 16:25:53 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:53 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:25:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Flow 'volume_create_manager' (83de98f9-315b-4e66-8b7f-d4042d3ae4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:25:53 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97c280a-89cb-49f3-b6f5-b008b847b071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:54 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ef85a1c6-cb53-48cd-86a1-cc6904b1e995 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a" returned: 0 in 0.815s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:54 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-ef85a1c6-cb53-48cd-86a1-cc6904b1e995 tempest-VolumesSnapshotListTestJSON-123257052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f85c6484-715f-4086-b95f-7a7971ab764d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:25:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ef85a1c6-cb53-48cd-86a1-cc6904b1e995 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:54 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb 1G Jun 02 16:25:54 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97c280a-89cb-49f3-b6f5-b008b847b071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:25:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-676465875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b24033b-cb30-4a16-9510-778976b313bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a230dc4fab9b450e9123462cabc5a8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:25:54Z,use_quota=True,user_id='61190807f8134243bd6e6c43043c01ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc47fd3-5041-490a-a884-3655adefaa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc47fd3-5041-490a-a884-3655adefaa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9866ec03-c687-4d17-9a84-e4bae4cc9e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9866ec03-c687-4d17-9a84-e4bae4cc9e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b24033b-cb30-4a16-9510-778976b313bf', 'volume_name': 'volume-5b24033b-cb30-4a16-9510-778976b313bf', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265a994e-86e2-48b2-b976-b9707633ab16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265a994e-86e2-48b2-b976-b9707633ab16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:54 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f728b4e-d6a7-4bdc-a029-99e7834dc25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:54 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Volume 5b24033b-cb30-4a16-9510-778976b313bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b24033b-cb30-4a16-9510-778976b313bf', 'volume_size': 1} Jun 02 16:25:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:55 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ef85a1c6-cb53-48cd-86a1-cc6904b1e995 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb 1G" returned: 0 in 1.047s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ef85a1c6-cb53-48cd-86a1-cc6904b1e995 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:55 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb Jun 02 16:25:55 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:56 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ef85a1c6-cb53-48cd-86a1-cc6904b1e995 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb" returned: 0 in 1.055s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:56 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-ef85a1c6-cb53-48cd-86a1-cc6904b1e995 tempest-VolumesSnapshotListTestJSON-123257052 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb is being set with open permissions: ugo+rw Jun 02 16:25:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ef85a1c6-cb53-48cd-86a1-cc6904b1e995 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:56 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb Jun 02 16:25:56 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:56 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ef85a1c6-cb53-48cd-86a1-cc6904b1e995 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb" returned: 0 in 0.780s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ef85a1c6-cb53-48cd-86a1-cc6904b1e995 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.841s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.820s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:56 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:25:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-676465875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b24033b-cb30-4a16-9510-778976b313bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a230dc4fab9b450e9123462cabc5a8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:25:54Z,use_quota=True,user_id='61190807f8134243bd6e6c43043c01ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:25:56 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Creating volume 5b24033b-cb30-4a16-9510-778976b313bf {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:25:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:56 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:25:56 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:25:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:56 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:25:56 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:25:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:56 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf 1073741824 Jun 02 16:25:56 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:57 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-ef85a1c6-cb53-48cd-86a1-cc6904b1e995 tempest-VolumesSnapshotListTestJSON-123257052 None] Create snapshot completed successfully Jun 02 16:25:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5e3af6d4-a300-4932-9da0-d33f331e4331 tempest-VolumesSnapshotListTestJSON-123257052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:25:57 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf 1073741824" returned: 0 in 0.953s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:57 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf Jun 02 16:25:57 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:58 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf" returned: 0 in 0.654s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:25:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:25:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5e3af6d4-a300-4932-9da0-d33f331e4331 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.883s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:25:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f728b4e-d6a7-4bdc-a029-99e7834dc25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b24033b-cb30-4a16-9510-778976b313bf', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b984f86-a3df-4c86-8f24-e986aeba4e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:25:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-5e3af6d4-a300-4932-9da0-d33f331e4331 tempest-VolumesSnapshotListTestJSON-123257052 None] Creating offline snapshot e7b21880-c2fa-42f5-925e-56ed33ec8ff6 of volume f85c6484-715f-4086-b95f-7a7971ab764d {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:25:58 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Volume volume-5b24033b-cb30-4a16-9510-778976b313bf (5b24033b-cb30-4a16-9510-778976b313bf): created successfully Jun 02 16:25:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b984f86-a3df-4c86-8f24-e986aeba4e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:25:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Flow 'volume_create_manager' (83de98f9-315b-4e66-8b7f-d4042d3ae4ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:25:58 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2d556f-371b-4b62-9d09-6c694d8a441e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:25:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5e3af6d4-a300-4932-9da0-d33f331e4331 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:58 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9de7a628-21a3-4d9c-a0c7-9739654621fc tempest-CinderUnicodeTest-536117729 None] Created volume successfully. Jun 02 16:25:58 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb Jun 02 16:25:58 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:59 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jun 02 16:25:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5e3af6d4-a300-4932-9da0-d33f331e4331 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb" returned: 0 in 0.862s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:25:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-5e3af6d4-a300-4932-9da0-d33f331e4331 tempest-VolumesSnapshotListTestJSON-123257052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f85c6484-715f-4086-b95f-7a7971ab764d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:25:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5e3af6d4-a300-4932-9da0-d33f331e4331 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:25:59 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6 1G Jun 02 16:25:59 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:25:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:26:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:26:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:26:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:00 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:26:00 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:00 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5e3af6d4-a300-4932-9da0-d33f331e4331 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6 1G" returned: 0 in 0.895s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5e3af6d4-a300-4932-9da0-d33f331e4331 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:00 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6 Jun 02 16:26:00 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:00 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.695s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:00 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:26:01 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5e3af6d4-a300-4932-9da0-d33f331e4331 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6" returned: 0 in 0.748s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:01 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-5e3af6d4-a300-4932-9da0-d33f331e4331 tempest-VolumesSnapshotListTestJSON-123257052 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6 is being set with open permissions: ugo+rw Jun 02 16:26:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5e3af6d4-a300-4932-9da0-d33f331e4331 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:01 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6 Jun 02 16:26:01 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:01 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5e3af6d4-a300-4932-9da0-d33f331e4331 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6" returned: 0 in 0.644s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5e3af6d4-a300-4932-9da0-d33f331e4331 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.347s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.283s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] Creating offline snapshot e5efe1aa-b1b0-454d-b307-6057cced0ee4 of volume 5b24033b-cb30-4a16-9510-778976b313bf {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:26:02 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a635aa71-9462-4c2c-b5a2-f8f703165231]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:02 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-5e3af6d4-a300-4932-9da0-d33f331e4331 tempest-VolumesSnapshotListTestJSON-123257052 None] Create snapshot completed successfully Jun 02 16:26:02 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=65,cinder:UPDATE=66,cinder:INSERT=16,cinder:DELETE=5 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:26:02 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:DELETE=10,cinder:SELECT=67,cinder:UPDATE=71,cinder:INSERT=13 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:26:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-cabf08b1-e65b-440b-b99e-f9e2586eefa9 req-e22d6d94-9727-4f28-96b5-cb0da6ddf61d tempest-TestStampPattern-1149610376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:02 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf Jun 02 16:26:02 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:02 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf" returned: 0 in 0.872s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:02 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4 1G Jun 02 16:26:02 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:03 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Acquiring lock "cinder-e7b21880-c2fa-42f5-925e-56ed33ec8ff6-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:03 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-e7b21880-c2fa-42f5-925e-56ed33ec8ff6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:03 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Acquiring lock "cinder-quobyte-f85c6484-715f-4086-b95f-7a7971ab764d" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:03 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4 1G" returned: 0 in 0.968s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b24033b-cb30-4a16-9510-778976b313bf -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:03 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-quobyte-f85c6484-715f-4086-b95f-7a7971ab764d" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:03 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Acquiring lock "cinder-quobyte-e7b21880-c2fa-42f5-925e-56ed33ec8ff6" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:03 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b24033b-cb30-4a16-9510-778976b313bf -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4 Jun 02 16:26:03 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:03 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-quobyte-e7b21880-c2fa-42f5-925e-56ed33ec8ff6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Deleting offline snapshot e7b21880-c2fa-42f5-925e-56ed33ec8ff6 of volume f85c6484-715f-4086-b95f-7a7971ab764d {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:26:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] snapshot_file for this snap is: volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:26:03 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1961713f-5b79-40fc-a0e8-0cc9c2d67c04]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:04 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6 Jun 02 16:26:04 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:04 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b24033b-cb30-4a16-9510-778976b313bf -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4" returned: 0 in 0.735s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:04 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4 is being set with open permissions: ugo+rw Jun 02 16:26:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:04 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4 Jun 02 16:26:04 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:04 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6" returned: 0 in 0.850s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f85c6484-715f-4086-b95f-7a7971ab764d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:26:04 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc48596-fab8-4704-8dbe-2417ded2f9c4]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:04 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb Jun 02 16:26:04 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:05 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4" returned: 0 in 0.667s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:05 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.info Jun 02 16:26:05 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:05 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb" returned: 0 in 0.810s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:05 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f85c6484-715f-4086-b95f-7a7971ab764d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:26:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:05 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6 Jun 02 16:26:05 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:05 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.info" returned: 0 in 0.667s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:05 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.info is being set with open permissions: ugo+rw Jun 02 16:26:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:06 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.info Jun 02 16:26:06 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:06 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6" returned: 0 in 0.821s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:06 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6 Jun 02 16:26:06 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:06 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.info" returned: 0 in 0.592s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.628s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-cabf08b1-e65b-440b-b99e-f9e2586eefa9 req-e22d6d94-9727-4f28-96b5-cb0da6ddf61d tempest-TestStampPattern-1149610376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.500s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:06 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e253527-bb72-47be-9182-38e1fc3e57d3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-cabf08b1-e65b-440b-b99e-f9e2586eefa9 req-e22d6d94-9727-4f28-96b5-cb0da6ddf61d tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:06 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-25663abe-5909-4f29-bc15-d8bd6cfcf077 tempest-CinderUnicodeTest-536117729 None] Create snapshot completed successfully Jun 02 16:26:06 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d Jun 02 16:26:06 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] Acquiring lock "cinder-e5efe1aa-b1b0-454d-b307-6057cced0ee4-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] Lock "cinder-e5efe1aa-b1b0-454d-b307-6057cced0ee4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] Acquiring lock "cinder-quobyte-5b24033b-cb30-4a16-9510-778976b313bf" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] Lock "cinder-quobyte-5b24033b-cb30-4a16-9510-778976b313bf" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] Acquiring lock "cinder-quobyte-e5efe1aa-b1b0-454d-b307-6057cced0ee4" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] Lock "cinder-quobyte-e5efe1aa-b1b0-454d-b307-6057cced0ee4" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] Deleting offline snapshot e5efe1aa-b1b0-454d-b307-6057cced0ee4 of volume 5b24033b-cb30-4a16-9510-778976b313bf {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:26:07 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] snapshot_file for this snap is: volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.e7b21880-c2fa-42f5-925e-56ed33ec8ff6" returned: 0 in 0.844s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0783eb6b-dac0-4a9d-a51f-2c793d9d2c5a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-quobyte-e7b21880-c2fa-42f5-925e-56ed33ec8ff6" released by "_delete_snapshot" :: held 3.457s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-quobyte-f85c6484-715f-4086-b95f-7a7971ab764d" released by "delete_snapshot" :: held 3.501s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:07 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4 Jun 02 16:26:07 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Created reservations ['a24d4749-18f3-44fb-9619-df0b824d113c', '4404270a-4b61-44f6-b3ba-4dd2df30d0e2', 'cb93da81-d55c-4c02-a521-49668fbad1f4', '9b2fe840-489c-4c22-844b-fe581e6f2117'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:26:07 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-cabf08b1-e65b-440b-b99e-f9e2586eefa9 req-e22d6d94-9727-4f28-96b5-cb0da6ddf61d tempest-TestStampPattern-1149610376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d" returned: 0 in 0.900s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-cabf08b1-e65b-440b-b99e-f9e2586eefa9 req-e22d6d94-9727-4f28-96b5-cb0da6ddf61d tempest-TestStampPattern-1149610376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.938s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:07 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Delete snapshot completed successfully. Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-adc3adee-a047-4d7a-8d6f-a94dedd16f01 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-e7b21880-c2fa-42f5-925e-56ed33ec8ff6-delete_snapshot" released by "delete_snapshot" :: held 3.720s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-cabf08b1-e65b-440b-b99e-f9e2586eefa9 req-e22d6d94-9727-4f28-96b5-cb0da6ddf61d tempest-TestStampPattern-1149610376 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f91fa1ce-f619-4123-91b8-bc333bba86b4', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:26:07 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-cabf08b1-e65b-440b-b99e-f9e2586eefa9 req-e22d6d94-9727-4f28-96b5-cb0da6ddf61d tempest-TestStampPattern-1149610376 None] attachment_update completed successfully. Jun 02 16:26:08 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4" returned: 0 in 0.795s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b24033b-cb30-4a16-9510-778976b313bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:26:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Acquiring lock "cinder-28b0085b-cd98-4173-b028-9e133cf167eb-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:08 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbccee8-06b9-4097-971f-a21e6a5c7e14]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-28b0085b-cd98-4173-b028-9e133cf167eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Acquiring lock "cinder-quobyte-f85c6484-715f-4086-b95f-7a7971ab764d" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-quobyte-f85c6484-715f-4086-b95f-7a7971ab764d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Acquiring lock "cinder-quobyte-28b0085b-cd98-4173-b028-9e133cf167eb" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-quobyte-28b0085b-cd98-4173-b028-9e133cf167eb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Deleting offline snapshot 28b0085b-cd98-4173-b028-9e133cf167eb of volume f85c6484-715f-4086-b95f-7a7971ab764d {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:26:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] snapshot_file for this snap is: volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:26:08 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b10bf3-c0de-457f-957b-10798d7ea222]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:08 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf Jun 02 16:26:08 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:08 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb Jun 02 16:26:08 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:09 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf" returned: 0 in 0.871s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:09 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4 Jun 02 16:26:09 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:09 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb" returned: 0 in 0.842s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f85c6484-715f-4086-b95f-7a7971ab764d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:26:09 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fb7094-cd63-441d-9af2-62f95057b4ab]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:09 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a Jun 02 16:26:09 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:09 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4" returned: 0 in 0.754s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:09 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4 Jun 02 16:26:09 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:10 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a" returned: 0 in 0.813s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f85c6484-715f-4086-b95f-7a7971ab764d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:26:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:10 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb Jun 02 16:26:10 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:10 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf.e5efe1aa-b1b0-454d-b307-6057cced0ee4" returned: 0 in 0.644s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] Lock "cinder-quobyte-e5efe1aa-b1b0-454d-b307-6057cced0ee4" released by "_delete_snapshot" :: held 3.234s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] Lock "cinder-quobyte-5b24033b-cb30-4a16-9510-778976b313bf" released by "delete_snapshot" :: held 3.272s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:10 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] Created reservations ['ea1a26f9-a526-4d7f-95f9-181a7bef4d81', '0cd6e53b-dedb-4fc4-8aa0-9aa06751c499', 'd1fa4c08-1bd2-4f77-bc43-2ac151684039', '38fe6bd2-6597-435e-ae76-cb85bb021f6d'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:26:10 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] Delete snapshot completed successfully. Jun 02 16:26:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b9018579-e832-4a8b-a797-1f45c36d7c46 tempest-CinderUnicodeTest-536117729 None] Lock "cinder-e5efe1aa-b1b0-454d-b307-6057cced0ee4-delete_snapshot" released by "delete_snapshot" :: held 3.417s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:10 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb" returned: 0 in 0.756s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:10 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb Jun 02 16:26:10 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:11 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.28b0085b-cd98-4173-b028-9e133cf167eb" returned: 0 in 0.591s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-quobyte-28b0085b-cd98-4173-b028-9e133cf167eb" released by "_delete_snapshot" :: held 3.109s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-quobyte-f85c6484-715f-4086-b95f-7a7971ab764d" released by "delete_snapshot" :: held 3.136s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] Acquiring lock "cinder-5b24033b-cb30-4a16-9510-778976b313bf-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] Lock "cinder-5b24033b-cb30-4a16-9510-778976b313bf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:11 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Created reservations ['ee8edd99-5f1b-48ab-b302-41d346008145', '8c739b85-a1ee-45fa-900b-ed39b273e0a7', '0d953519-ae2c-4f37-8e1d-d21dbafb334c', 'adfd48cb-0a5b-454a-9e7d-ec2644c780af'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:26:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] Acquiring lock "cinder-quobyte-5b24033b-cb30-4a16-9510-778976b313bf" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] Lock "cinder-quobyte-5b24033b-cb30-4a16-9510-778976b313bf" acquired by "delete_volume" :: waited 0.026s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:11 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Delete snapshot completed successfully. Jun 02 16:26:11 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[41326262-5cae-4855-bddd-76416fd80481]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-22077b2b-9789-4e0a-ad1d-ff5a617b2ec8 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-28b0085b-cd98-4173-b028-9e133cf167eb-delete_snapshot" released by "delete_snapshot" :: held 3.363s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:11 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf Jun 02 16:26:11 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:12 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf" returned: 0 in 0.722s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:12 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf Jun 02 16:26:12 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] Acquiring lock "cinder-015caa7a-ab7a-44a3-9cb9-c436e09a5a7a-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-015caa7a-ab7a-44a3-9cb9-c436e09a5a7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] Acquiring lock "cinder-quobyte-f85c6484-715f-4086-b95f-7a7971ab764d" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-quobyte-f85c6484-715f-4086-b95f-7a7971ab764d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] Acquiring lock "cinder-quobyte-015caa7a-ab7a-44a3-9cb9-c436e09a5a7a" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-quobyte-015caa7a-ab7a-44a3-9cb9-c436e09a5a7a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:12 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] Deleting offline snapshot 015caa7a-ab7a-44a3-9cb9-c436e09a5a7a of volume f85c6484-715f-4086-b95f-7a7971ab764d {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:26:12 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] snapshot_file for this snap is: volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:26:12 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4dc637-1d4d-4fac-9143-3fe16ae32489]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:12 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a Jun 02 16:26:12 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:12 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5b24033b-cb30-4a16-9510-778976b313bf" returned: 0 in 0.657s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] Lock "cinder-quobyte-5b24033b-cb30-4a16-9510-778976b313bf" released by "delete_volume" :: held 1.463s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] Created reservations ['c566b32b-00b4-47e7-bdb7-f2ce1d2af076', '8048868f-2344-44f9-a85e-8695c36833af', '7961657c-3649-45dd-80fa-89f441843d3a', 'f8bbcc51-c1ca-4ce9-9c81-a84941b42cc5'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:13 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:26:13 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:13 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a" returned: 0 in 0.798s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f85c6484-715f-4086-b95f-7a7971ab764d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7013dd-fb16-4a1b-a831-6417ccfb86aa]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:13 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d Jun 02 16:26:13 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] Acquiring lock "cinder-0871fe59-6481-41b3-8676-7211c45e84fc-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] Lock "cinder-0871fe59-6481-41b3-8676-7211c45e84fc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] Acquiring lock "cinder-quobyte-0871fe59-6481-41b3-8676-7211c45e84fc" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] Lock "cinder-quobyte-0871fe59-6481-41b3-8676-7211c45e84fc" acquired by "delete_volume" :: waited 0.017s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:13 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.689s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:26:13 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] Deleted volume successfully. Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e5a278-9cc4-42be-a3c8-fd525884ce44]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0871fe59-6481-41b3-8676-7211c45e84fc {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-01645667-c5c6-4765-99fe-fdfed7ff21b2 tempest-CinderUnicodeTest-536117729 None] Lock "cinder-5b24033b-cb30-4a16-9510-778976b313bf-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:13 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0871fe59-6481-41b3-8676-7211c45e84fc Jun 02 16:26:13 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:14 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d" returned: 0 in 0.872s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:14 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a Jun 02 16:26:14 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:14 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0871fe59-6481-41b3-8676-7211c45e84fc" returned: 0 in 0.731s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0871fe59-6481-41b3-8676-7211c45e84fc {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:14 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0871fe59-6481-41b3-8676-7211c45e84fc Jun 02 16:26:14 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:15 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a" returned: 0 in 0.870s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:15 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a Jun 02 16:26:15 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:15 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-2e7cec85-eb0c-45dd-b7c5-d32005a3535f req-592a409f-0dad-409f-b7be-33bd15d9d7b2 tempest-TestStampPattern-1149610376 None] Terminate volume connection completed successfully. Jun 02 16:26:15 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-2e7cec85-eb0c-45dd-b7c5-d32005a3535f req-592a409f-0dad-409f-b7be-33bd15d9d7b2 tempest-TestStampPattern-1149610376 None] Deleting attachment f91fa1ce-f619-4123-91b8-bc333bba86b4. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:26:15 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0871fe59-6481-41b3-8676-7211c45e84fc" returned: 0 in 0.704s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] Lock "cinder-quobyte-0871fe59-6481-41b3-8676-7211c45e84fc" released by "delete_volume" :: held 1.493s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:15 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] Created reservations ['19781d7c-9d0d-443d-90ee-a0bf60c5079c', '3d859b75-97c1-461b-a17d-c0a3c47ed497', '6ff02257-1b91-4cf3-8a3c-13c722c31182', 'b8a8abc9-728d-4043-9c67-eee83fbde20c'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:26:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:15 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:26:15 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:26:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:15 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:26:15 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:15 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d.015caa7a-ab7a-44a3-9cb9-c436e09a5a7a" returned: 0 in 0.760s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-quobyte-015caa7a-ab7a-44a3-9cb9-c436e09a5a7a" released by "_delete_snapshot" :: held 3.496s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-quobyte-f85c6484-715f-4086-b95f-7a7971ab764d" released by "delete_snapshot" :: held 3.524s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:16 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] Created reservations ['af46a41d-fb37-4615-ae06-8f379d69cf47', '763f0e75-10b6-42ba-bb60-20aabf4d1932', '3b422d30-3676-4a9a-b43d-39f33fd2f48d', '81951820-d13c-49cc-a63b-f7e78d76b0e2'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:26:16 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] Delete snapshot completed successfully. Jun 02 16:26:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dfe362e8-4288-4525-b7ce-0beea7bfc835 tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-015caa7a-ab7a-44a3-9cb9-c436e09a5a7a-delete_snapshot" released by "delete_snapshot" :: held 3.706s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:16 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.781s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:16 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:26:16 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] Deleted volume successfully. Jun 02 16:26:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7e4cb4cc-8c96-4d8c-bac5-869425eec680 tempest-CinderUnicodeTest-536117729 None] Lock "cinder-0871fe59-6481-41b3-8676-7211c45e84fc-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] Acquiring lock "cinder-f85c6484-715f-4086-b95f-7a7971ab764d-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-f85c6484-715f-4086-b95f-7a7971ab764d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] Acquiring lock "cinder-quobyte-f85c6484-715f-4086-b95f-7a7971ab764d" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-quobyte-f85c6484-715f-4086-b95f-7a7971ab764d" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:16 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd3d2ce-5adf-4c77-b9cc-36ff0f968049]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:17 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d Jun 02 16:26:17 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:17 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d" returned: 0 in 0.945s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:17 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d Jun 02 16:26:17 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:18 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f85c6484-715f-4086-b95f-7a7971ab764d" returned: 0 in 0.839s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-quobyte-f85c6484-715f-4086-b95f-7a7971ab764d" released by "delete_volume" :: held 1.877s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:18 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] Created reservations ['67996fea-651a-4132-a280-69bf7be366f1', '67083620-74db-4a46-a3e8-c11ef361c3b2', 'e4da2526-ec41-497d-8a76-5f56a524af5d', 'f9fe76a0-f7bf-4996-8861-dd84a3bedec3'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:26:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:26:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:26:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:18 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:26:18 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:19 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.776s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:19 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:26:19 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] Deleted volume successfully. Jun 02 16:26:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d33bf0d6-ba20-4d1c-a007-77ecb2d49a7e tempest-VolumesSnapshotListTestJSON-123257052 None] Lock "cinder-f85c6484-715f-4086-b95f-7a7971ab764d-delete_volume" released by "delete_volume" :: held 2.930s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:22 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-2e686b79-0375-4561-a7ed-29e1f91a389c req-5a37cfd2-5d5e-4391-b6e8-1b6bdc0e20cd tempest-TestMinimumBasicScenario-918015095 None] Terminate volume connection completed successfully. Jun 02 16:26:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-2e686b79-0375-4561-a7ed-29e1f91a389c req-5a37cfd2-5d5e-4391-b6e8-1b6bdc0e20cd tempest-TestMinimumBasicScenario-918015095 None] Deleting attachment 0a252600-eefc-449e-ab55-76184170f769. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Flow 'volume_create_manager' (3ae1e7f8-4ad7-41da-b161-56c18c2369f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e168107f-ecd5-46b4-bd14-3fac7ab7ddda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e168107f-ecd5-46b4-bd14-3fac7ab7ddda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1764523372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fb9652-859c-40b0-b768-09661889a40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='978587c962f94d0e824f1a23eebad230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:26:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:26:23Z,use_quota=True,user_id='fc44433bc8684744bcf15cc16df3fb63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52530cdc-2d59-4e31-9730-769e20dc4307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52530cdc-2d59-4e31-9730-769e20dc4307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57478743-7ee6-450e-b57d-a8df20eccd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57478743-7ee6-450e-b57d-a8df20eccd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09fb9652-859c-40b0-b768-09661889a40c', 'volume_name': 'volume-09fb9652-859c-40b0-b768-09661889a40c', 'volume_size': 2}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb585a6a-ac80-475a-b2fa-4732c142954b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb585a6a-ac80-475a-b2fa-4732c142954b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5209f6-261f-4a80-8786-a23ebe53f114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:23 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Volume 09fb9652-859c-40b0-b768-09661889a40c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09fb9652-859c-40b0-b768-09661889a40c', 'volume_size': 2} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1764523372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fb9652-859c-40b0-b768-09661889a40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='978587c962f94d0e824f1a23eebad230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:26:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:26:23Z,use_quota=True,user_id='fc44433bc8684744bcf15cc16df3fb63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Creating volume 09fb9652-859c-40b0-b768-09661889a40c {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:26:23 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:26:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c 2147483648 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:23 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c 2147483648 Jun 02 16:26:23 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:24 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c 2147483648" returned: 0 in 0.854s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:24 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c Jun 02 16:26:24 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] Acquiring lock "cinder-d7af30eb-04af-4de3-b34f-8cd84c5a53b5-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] Lock "cinder-d7af30eb-04af-4de3-b34f-8cd84c5a53b5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] Acquiring lock "cinder-quobyte-d7af30eb-04af-4de3-b34f-8cd84c5a53b5" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] Lock "cinder-quobyte-d7af30eb-04af-4de3-b34f-8cd84c5a53b5" acquired by "delete_volume" :: waited 0.025s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:24 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[52525b49-bd6b-47e5-bdaf-8ae5fc33cf09]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:24 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5 Jun 02 16:26:24 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:24 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c" returned: 0 in 0.625s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:26:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5209f6-261f-4a80-8786-a23ebe53f114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09fb9652-859c-40b0-b768-09661889a40c', 'volume_size': 2}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e7b99c-95fc-4a0b-b47d-477d62fa0b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:24 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Volume volume-09fb9652-859c-40b0-b768-09661889a40c (09fb9652-859c-40b0-b768-09661889a40c): created successfully Jun 02 16:26:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e7b99c-95fc-4a0b-b47d-477d62fa0b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Flow 'volume_create_manager' (3ae1e7f8-4ad7-41da-b161-56c18c2369f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:26:24 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-2fd38e18-78d8-4645-b8cf-98a76247d923 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Created volume successfully. Jun 02 16:26:25 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5" returned: 0 in 0.731s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:25 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5 Jun 02 16:26:25 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Creating offline snapshot b140f505-1932-44e9-8da5-a37cf0747258 of volume 09fb9652-859c-40b0-b768-09661889a40c {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e9212f-d316-44b0-b167-e798fa168b57]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] Acquiring lock "cinder-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] Lock "cinder-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:25 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c Jun 02 16:26:25 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] Acquiring lock "cinder-quobyte-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] Lock "cinder-quobyte-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d" acquired by "delete_volume" :: waited 0.021s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8100f1e1-e922-4ab4-807a-f82b02f9c331]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:25 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d7af30eb-04af-4de3-b34f-8cd84c5a53b5" returned: 0 in 0.646s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] Lock "cinder-quobyte-d7af30eb-04af-4de3-b34f-8cd84c5a53b5" released by "delete_volume" :: held 1.435s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:25 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d Jun 02 16:26:25 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] Created reservations ['97e16ba7-b4ff-4a08-af05-404593bfbc27', 'd299caa9-8858-49ce-9c47-ac1dac6c73e9', '00cd0059-66c1-4c34-974a-818536b576e9', '5e495e33-ae73-41a4-b50b-c2375cfc4a01'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:25 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:26:25 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:26 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c" returned: 0 in 0.765s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258 2G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:26 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258 2G Jun 02 16:26:26 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:26 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d" returned: 0 in 0.802s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:26 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d Jun 02 16:26:26 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:26 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.674s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:26 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:26:26 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] Deleted volume successfully. Jun 02 16:26:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-f5c43366-009c-4c6f-b57a-ddc2b00f7c2f tempest-TestMinimumBasicScenario-918015095 None] Lock "cinder-d7af30eb-04af-4de3-b34f-8cd84c5a53b5-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:27 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258 2G" returned: 0 in 0.865s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09fb9652-859c-40b0-b768-09661889a40c -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:27 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09fb9652-859c-40b0-b768-09661889a40c -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258 Jun 02 16:26:27 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:27 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d" returned: 0 in 0.687s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:27 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] Lock "cinder-quobyte-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d" released by "delete_volume" :: held 1.539s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:27 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] Created reservations ['a4cc2d94-fce1-4b15-83b0-52191990f9fd', '7c146cbf-c580-4719-b61c-a4a74be1904d', '1a2b6c14-952c-4b70-bde8-7f5e0d6ca307', 'ae88b261-6c75-4824-8f0e-cb6675f2ebc8'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:26:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:27 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:26:27 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:26:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:27 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:26:27 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:28 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09fb9652-859c-40b0-b768-09661889a40c -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258" returned: 0 in 0.916s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:28 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258 is being set with open permissions: ugo+rw Jun 02 16:26:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:28 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258 Jun 02 16:26:28 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:28 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.931s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:28 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:26:28 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] Deleted volume successfully. Jun 02 16:26:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0a680d25-cf3e-4984-972b-2d92a558dfce tempest-TestStampPattern-1149610376 None] Lock "cinder-c9f4148b-8fe5-4bf2-a11c-d0e79dd2223d-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] Acquiring lock "cinder-14cbd723-94c3-4409-b0de-7c8c73fc26e2-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] Lock "cinder-14cbd723-94c3-4409-b0de-7c8c73fc26e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] Acquiring lock "cinder-quobyte-2e73d250-c906-4381-9237-9091b7933b78" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] Lock "cinder-quobyte-2e73d250-c906-4381-9237-9091b7933b78" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] Acquiring lock "cinder-quobyte-14cbd723-94c3-4409-b0de-7c8c73fc26e2" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] Lock "cinder-quobyte-14cbd723-94c3-4409-b0de-7c8c73fc26e2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] Deleting offline snapshot 14cbd723-94c3-4409-b0de-7c8c73fc26e2 of volume 2e73d250-c906-4381-9237-9091b7933b78 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:26:28 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] snapshot_file for this snap is: volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:26:28 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d13895a-2aa0-4e76-b8d5-0959db8b17ae]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:28 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258" returned: 0 in 0.953s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:29 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2 Jun 02 16:26:29 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:29 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.info Jun 02 16:26:29 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:29 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.info" returned: 0 in 0.732s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:29 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.info is being set with open permissions: ugo+rw Jun 02 16:26:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:29 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2" returned: 0 in 0.845s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e73d250-c906-4381-9237-9091b7933b78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:26:29 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.info Jun 02 16:26:29 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:29 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[17304285-76b4-4e3c-8ae0-9ba6d6b4fad3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:29 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 Jun 02 16:26:29 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:30 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.info" returned: 0 in 0.625s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.966s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:30 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-54382501-89e6-4826-a5a6-a3bd3a7a510c tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Create snapshot completed successfully Jun 02 16:26:30 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78" returned: 0 in 0.853s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:30 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2 Jun 02 16:26:30 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:30 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Acquiring lock "cinder-b140f505-1932-44e9-8da5-a37cf0747258-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:30 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "cinder-b140f505-1932-44e9-8da5-a37cf0747258-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:30 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Acquiring lock "cinder-quobyte-09fb9652-859c-40b0-b768-09661889a40c" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:30 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "cinder-quobyte-09fb9652-859c-40b0-b768-09661889a40c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:30 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Acquiring lock "cinder-quobyte-b140f505-1932-44e9-8da5-a37cf0747258" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:30 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "cinder-quobyte-b140f505-1932-44e9-8da5-a37cf0747258" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:30 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Deleting offline snapshot b140f505-1932-44e9-8da5-a37cf0747258 of volume 09fb9652-859c-40b0-b768-09661889a40c {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:26:30 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] snapshot_file for this snap is: volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:26:30 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd1cf09-d810-420a-9f24-5b6574caaf61]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:31 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258 Jun 02 16:26:31 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:31 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2" returned: 0 in 0.799s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:31 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2 Jun 02 16:26:31 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:31 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258" returned: 0 in 0.770s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09fb9652-859c-40b0-b768-09661889a40c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:26:31 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[264357a5-2201-48c7-9b8b-74e48bd9cf16]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:31 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c Jun 02 16:26:31 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:32 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78.14cbd723-94c3-4409-b0de-7c8c73fc26e2" returned: 0 in 0.625s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] Lock "cinder-quobyte-14cbd723-94c3-4409-b0de-7c8c73fc26e2" released by "_delete_snapshot" :: held 3.235s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] Lock "cinder-quobyte-2e73d250-c906-4381-9237-9091b7933b78" released by "delete_snapshot" :: held 3.260s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:32 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] Created reservations ['0174c151-501b-4d12-8b38-8b8d02a3e15b', 'd8db486c-1096-4dc9-8bbe-7c7c1a201b55', 'dbe0b38a-b0f4-4a97-bdb7-89a86a393ee8', 'c30cfeed-6029-408b-8b17-76fe7aefcba1'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:26:32 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] Delete snapshot completed successfully. Jun 02 16:26:32 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-85ae9fef-9cbe-4b38-b981-9fbb0b7c5fa6 tempest-TestStampPattern-1149610376 None] Lock "cinder-14cbd723-94c3-4409-b0de-7c8c73fc26e2-delete_snapshot" released by "delete_snapshot" :: held 3.451s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:32 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c" returned: 0 in 0.772s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:32 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258 Jun 02 16:26:32 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:33 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258" returned: 0 in 0.744s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:33 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258 Jun 02 16:26:33 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:33 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c.b140f505-1932-44e9-8da5-a37cf0747258" returned: 0 in 0.727s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "cinder-quobyte-b140f505-1932-44e9-8da5-a37cf0747258" released by "_delete_snapshot" :: held 3.150s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "cinder-quobyte-09fb9652-859c-40b0-b768-09661889a40c" released by "delete_snapshot" :: held 3.179s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:34 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Created reservations ['055ae5c4-f723-400e-a2df-cdc6c6e2c4e8', '97eb3066-b1b4-4835-90ab-23727f96bff3', '94287799-c104-4115-aa1a-7b5d97d06e5a', 'ae78f11c-f5fa-4487-9fa8-dad3eac43ca7'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:26:34 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Delete snapshot completed successfully. Jun 02 16:26:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9e229055-e4cd-4568-a8ee-af6b75b23a4f tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "cinder-b140f505-1932-44e9-8da5-a37cf0747258-delete_snapshot" released by "delete_snapshot" :: held 3.350s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Acquiring lock "cinder-09fb9652-859c-40b0-b768-09661889a40c-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "cinder-09fb9652-859c-40b0-b768-09661889a40c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Acquiring lock "cinder-quobyte-09fb9652-859c-40b0-b768-09661889a40c" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "cinder-quobyte-09fb9652-859c-40b0-b768-09661889a40c" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:35 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb237d0-2aa2-4b1d-92dc-f8add984788b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:35 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c Jun 02 16:26:35 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:36 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c" returned: 0 in 0.825s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:36 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c Jun 02 16:26:36 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:36 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-09fb9652-859c-40b0-b768-09661889a40c" returned: 0 in 0.683s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "cinder-quobyte-09fb9652-859c-40b0-b768-09661889a40c" released by "delete_volume" :: held 1.631s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:37 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Created reservations ['f305a19a-f6ad-4047-a373-2c84daab839c', 'e14df454-90f4-41e4-bf29-0539449973dc', '7a3d5953-7e41-4333-a0ff-242ed0275712', '6b5fd4f1-46ac-4888-add4-c187aa96e804'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:26:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:37 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:26:37 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:26:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:37 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:26:37 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:37 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.724s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:37 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:26:37 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Deleted volume successfully. Jun 02 16:26:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b121e70d-7b9d-489e-8d17-cc0a6eb00425 tempest-VolumesSnapshotNegativeTestJSON-1514810434 None] Lock "cinder-09fb9652-859c-40b0-b768-09661889a40c-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] Acquiring lock "cinder-2e73d250-c906-4381-9237-9091b7933b78-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] Lock "cinder-2e73d250-c906-4381-9237-9091b7933b78-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] Acquiring lock "cinder-quobyte-2e73d250-c906-4381-9237-9091b7933b78" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] Lock "cinder-quobyte-2e73d250-c906-4381-9237-9091b7933b78" acquired by "delete_volume" :: waited 0.034s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[02926ac9-9816-4a8a-a32c-e2480f03d1e6]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Flow 'volume_create_manager' (b47b9fab-f769-417b-933b-3f41d612e832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b334f61-0801-47ea-9a2e-57a0f85ac168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:46 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 Jun 02 16:26:46 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b334f61-0801-47ea-9a2e-57a0f85ac168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-406428529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e235db06-44bc-4109-a76d-efa855acf120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34576647a2764f1f962eb20d378a01c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:26:46Z,use_quota=True,user_id='cd7cb8b784d14d6fb4a48e88c96948ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8241ce1f-4b03-4128-9bfa-da05a65a6c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8241ce1f-4b03-4128-9bfa-da05a65a6c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70294cc-addb-4847-b98a-977644d8649c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70294cc-addb-4847-b98a-977644d8649c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e235db06-44bc-4109-a76d-efa855acf120', 'volume_name': 'volume-e235db06-44bc-4109-a76d-efa855acf120', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d323ee-ab66-4129-8717-66074659be25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d323ee-ab66-4129-8717-66074659be25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f90176-21a1-4a77-9c19-78762873ca32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:46 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume e235db06-44bc-4109-a76d-efa855acf120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e235db06-44bc-4109-a76d-efa855acf120', 'volume_size': 1} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-406428529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e235db06-44bc-4109-a76d-efa855acf120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34576647a2764f1f962eb20d378a01c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:26:46Z,use_quota=True,user_id='cd7cb8b784d14d6fb4a48e88c96948ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Creating volume e235db06-44bc-4109-a76d-efa855acf120 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:26:46 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:26:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:46 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120 1073741824 Jun 02 16:26:46 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:47 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78" returned: 0 in 1.043s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:47 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78 Jun 02 16:26:47 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:47 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120 1073741824" returned: 0 in 1.075s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:47 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120 Jun 02 16:26:47 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:48 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2e73d250-c906-4381-9237-9091b7933b78" returned: 0 in 0.901s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] Lock "cinder-quobyte-2e73d250-c906-4381-9237-9091b7933b78" released by "delete_volume" :: held 2.073s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:48 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] Created reservations ['38f45d9c-25ef-4c65-91ee-78250256e56f', 'edf29b6a-fa19-4f38-a1a6-930100d4d105', '39450088-2413-4e65-8692-8af7699cf7f6', '90943c1e-d60e-47dd-8df3-29843902c340'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:26:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:26:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:26:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:48 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:26:48 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:48 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120" returned: 0 in 0.940s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:26:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f90176-21a1-4a77-9c19-78762873ca32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e235db06-44bc-4109-a76d-efa855acf120', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ca43ac-6ea3-4bac-be97-3064cb3d7de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:48 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume volume-e235db06-44bc-4109-a76d-efa855acf120 (e235db06-44bc-4109-a76d-efa855acf120): created successfully Jun 02 16:26:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ca43ac-6ea3-4bac-be97-3064cb3d7de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Flow 'volume_create_manager' (b47b9fab-f769-417b-933b-3f41d612e832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:26:48 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-264e31ec-2b13-4c0a-911c-dbabb209165d tempest-CreateVolumesFromSnapshotTest-1705705109 None] Created volume successfully. Jun 02 16:26:49 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.730s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:49 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:26:49 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] Deleted volume successfully. Jun 02 16:26:49 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a944c72d-8710-4dc8-bb86-1ca347431a75 tempest-TestStampPattern-1149610376 None] Lock "cinder-2e73d250-c906-4381-9237-9091b7933b78-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:26:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:49 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Creating offline snapshot b78a59c0-c686-470b-b0b3-93ad9c2f7725 of volume e235db06-44bc-4109-a76d-efa855acf120 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:26:49 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[95496871-84c3-4524-b7e2-0c5f7740f7ef]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:26:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:50 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120 Jun 02 16:26:50 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:50 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120" returned: 0 in 0.947s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:50 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725 1G Jun 02 16:26:50 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:51 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725 1G" returned: 0 in 0.957s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e235db06-44bc-4109-a76d-efa855acf120 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:51 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e235db06-44bc-4109-a76d-efa855acf120 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725 Jun 02 16:26:51 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:52 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e235db06-44bc-4109-a76d-efa855acf120 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725" returned: 0 in 0.852s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:52 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725 is being set with open permissions: ugo+rw Jun 02 16:26:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:52 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725 Jun 02 16:26:52 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:53 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725" returned: 0 in 0.832s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:53 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.info Jun 02 16:26:53 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:54 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.info" returned: 0 in 0.736s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:54 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.info is being set with open permissions: ugo+rw Jun 02 16:26:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:54 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.info Jun 02 16:26:54 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:55 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.info" returned: 0 in 0.668s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.117s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:55 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-5053bff0-c6d1-43f9-a021-21af44fd3ed1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Create snapshot completed successfully Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Flow 'volume_create_manager' (3afe3d3f-87e6-4922-a9ae-fc279fdf7d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50287d31-b01c-42f1-8c45-3810eb471ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50287d31-b01c-42f1-8c45-3810eb471ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1992393487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ef7db7-17b9-448c-9236-457b3e95f49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34576647a2764f1f962eb20d378a01c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:26:56Z,use_quota=True,user_id='cd7cb8b784d14d6fb4a48e88c96948ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14595bc8-7b1d-4cf7-9526-d3d2f2e44951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14595bc8-7b1d-4cf7-9526-d3d2f2e44951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea13443f-c326-48ff-9bf2-640d95596506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea13443f-c326-48ff-9bf2-640d95596506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0ef7db7-17b9-448c-9236-457b3e95f49b', 'volume_name': 'volume-a0ef7db7-17b9-448c-9236-457b3e95f49b', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c98ef3-d5cd-4d3a-9d00-ea2699b62ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c98ef3-d5cd-4d3a-9d00-ea2699b62ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4e8d1a-5405-4848-bd7b-3d1ff8642d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:55 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume a0ef7db7-17b9-448c-9236-457b3e95f49b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0ef7db7-17b9-448c-9236-457b3e95f49b', 'volume_size': 1} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1992393487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ef7db7-17b9-448c-9236-457b3e95f49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34576647a2764f1f962eb20d378a01c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:26:56Z,use_quota=True,user_id='cd7cb8b784d14d6fb4a48e88c96948ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Creating volume a0ef7db7-17b9-448c-9236-457b3e95f49b {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:26:55 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:26:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a0ef7db7-17b9-448c-9236-457b3e95f49b 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:55 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a0ef7db7-17b9-448c-9236-457b3e95f49b 1073741824 Jun 02 16:26:55 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Flow 'volume_create_manager' (d70697a2-042a-4e50-8a2f-fd38a8ba1d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf3102a-4e8c-4c3c-87a2-1be6c1e5b7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf3102a-4e8c-4c3c-87a2-1be6c1e5b7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-944248421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e91acd-a30a-4fbb-9319-56dd68adb875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34576647a2764f1f962eb20d378a01c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:26:56Z,use_quota=True,user_id='cd7cb8b784d14d6fb4a48e88c96948ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c427120-8346-4551-9338-88d444b13d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c427120-8346-4551-9338-88d444b13d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc51a761-2095-421b-8777-6e139f03577f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc51a761-2095-421b-8777-6e139f03577f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e91acd-a30a-4fbb-9319-56dd68adb875', 'volume_name': 'volume-79e91acd-a30a-4fbb-9319-56dd68adb875', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7808261-83ec-452e-91cc-8fba1141e8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7808261-83ec-452e-91cc-8fba1141e8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707bc3b2-b661-4aa5-83e1-a00761676a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:56 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume 79e91acd-a30a-4fbb-9319-56dd68adb875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e91acd-a30a-4fbb-9319-56dd68adb875', 'volume_size': 1} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Flow 'volume_create_manager' (231bb025-bc43-4b2d-924e-683e6b79fa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dcdcd17-3538-4727-b00c-f8727787deba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dcdcd17-3538-4727-b00c-f8727787deba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1042364034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662e0059-1c73-4075-8c5c-d54b321dcc6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34576647a2764f1f962eb20d378a01c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:26:57Z,use_quota=True,user_id='cd7cb8b784d14d6fb4a48e88c96948ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802edc09-44bd-4b68-bf53-94bde9dd65d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802edc09-44bd-4b68-bf53-94bde9dd65d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9303cfa4-142e-4075-8bfb-da6d2fb3cdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9303cfa4-142e-4075-8bfb-da6d2fb3cdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662e0059-1c73-4075-8c5c-d54b321dcc6d', 'volume_name': 'volume-662e0059-1c73-4075-8c5c-d54b321dcc6d', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be4869b-ff98-4c97-94eb-18f801e62249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be4869b-ff98-4c97-94eb-18f801e62249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (908f54ae-a996-4cb3-b4b7-6f782a9f3db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:57 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume 662e0059-1c73-4075-8c5c-d54b321dcc6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662e0059-1c73-4075-8c5c-d54b321dcc6d', 'volume_size': 1} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:57 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a0ef7db7-17b9-448c-9236-457b3e95f49b 1073741824" returned: 0 in 1.337s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a0ef7db7-17b9-448c-9236-457b3e95f49b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Flow 'volume_create_manager' (edef3f60-4501-49da-a5ae-e447e027811a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c85e92-85c3-402a-b345-01e9f9dac903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:57 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a0ef7db7-17b9-448c-9236-457b3e95f49b Jun 02 16:26:57 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c85e92-85c3-402a-b345-01e9f9dac903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1581502346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9dc1b7d-2cec-44a3-994d-6e7ce05928e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34576647a2764f1f962eb20d378a01c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:26:57Z,use_quota=True,user_id='cd7cb8b784d14d6fb4a48e88c96948ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d734299f-51f2-45a8-9259-4dfd30a1f4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d734299f-51f2-45a8-9259-4dfd30a1f4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2d9791-d569-4a4b-a8c7-9f031422fb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2d9791-d569-4a4b-a8c7-9f031422fb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9dc1b7d-2cec-44a3-994d-6e7ce05928e9', 'volume_name': 'volume-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e5fff0-1685-4ef2-bdd5-e21d9baae3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e5fff0-1685-4ef2-bdd5-e21d9baae3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb565844-0307-46e0-a38e-77c215d37e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:57 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume d9dc1b7d-2cec-44a3-994d-6e7ce05928e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9', 'volume_size': 1} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Flow 'volume_create_manager' (5d65c05f-8d06-4c7b-aaa1-c0a01202be81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44312baf-f345-4d37-b5e5-8c1f228bd6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44312baf-f345-4d37-b5e5-8c1f228bd6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-192770021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65026e9-859c-44dd-ad9f-d470e777bf65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34576647a2764f1f962eb20d378a01c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:26:58Z,use_quota=True,user_id='cd7cb8b784d14d6fb4a48e88c96948ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56253066-219f-4dab-a320-eefe657e670a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56253066-219f-4dab-a320-eefe657e670a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bca99bf-1c4e-48de-8b30-36235e2caedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bca99bf-1c4e-48de-8b30-36235e2caedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f65026e9-859c-44dd-ad9f-d470e777bf65', 'volume_name': 'volume-f65026e9-859c-44dd-ad9f-d470e777bf65', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fcad372-530c-4db0-b882-574b541ac7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fcad372-530c-4db0-b882-574b541ac7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79683342-fccc-49a4-abe5-afaf60917031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:57 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume f65026e9-859c-44dd-ad9f-d470e777bf65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f65026e9-859c-44dd-ad9f-d470e777bf65', 'volume_size': 1} Jun 02 16:26:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:58 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a0ef7db7-17b9-448c-9236-457b3e95f49b" returned: 0 in 0.818s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:26:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.230s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.706s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-944248421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e91acd-a30a-4fbb-9319-56dd68adb875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34576647a2764f1f962eb20d378a01c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:26:56Z,use_quota=True,user_id='cd7cb8b784d14d6fb4a48e88c96948ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:26:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Creating volume 79e91acd-a30a-4fbb-9319-56dd68adb875 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:26:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:26:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:26:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:26:58 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:26:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-79e91acd-a30a-4fbb-9319-56dd68adb875 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:58 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-79e91acd-a30a-4fbb-9319-56dd68adb875 1073741824 Jun 02 16:26:58 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4e8d1a-5405-4848-bd7b-3d1ff8642d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ef7db7-17b9-448c-9236-457b3e95f49b', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6888c7e-de53-4e4c-b3f7-f2ab58fdb202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:26:58 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume volume-a0ef7db7-17b9-448c-9236-457b3e95f49b (a0ef7db7-17b9-448c-9236-457b3e95f49b): created successfully Jun 02 16:26:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6888c7e-de53-4e4c-b3f7-f2ab58fdb202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:26:58 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Flow 'volume_create_manager' (3afe3d3f-87e6-4922-a9ae-fc279fdf7d68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:26:58 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-825853b0-f2b2-42bb-8445-d5a156dd2b15 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Created volume successfully. Jun 02 16:26:59 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-79e91acd-a30a-4fbb-9319-56dd68adb875 1073741824" returned: 0 in 1.060s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-79e91acd-a30a-4fbb-9319-56dd68adb875 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:26:59 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-79e91acd-a30a-4fbb-9319-56dd68adb875 Jun 02 16:26:59 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:26:59 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jun 02 16:26:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-79e91acd-a30a-4fbb-9319-56dd68adb875" returned: 0 in 0.769s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:26:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:26:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:26:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.972s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1042364034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662e0059-1c73-4075-8c5c-d54b321dcc6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34576647a2764f1f962eb20d378a01c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:26:57Z,use_quota=True,user_id='cd7cb8b784d14d6fb4a48e88c96948ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:26:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Creating volume 662e0059-1c73-4075-8c5c-d54b321dcc6d {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:26:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:26:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:26:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:27:00 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:27:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-662e0059-1c73-4075-8c5c-d54b321dcc6d 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707bc3b2-b661-4aa5-83e1-a00761676a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e91acd-a30a-4fbb-9319-56dd68adb875', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:00 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-662e0059-1c73-4075-8c5c-d54b321dcc6d 1073741824 Jun 02 16:27:00 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da807bec-f5fb-4909-8016-e32e1772807e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:00 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume volume-79e91acd-a30a-4fbb-9319-56dd68adb875 (79e91acd-a30a-4fbb-9319-56dd68adb875): created successfully Jun 02 16:27:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da807bec-f5fb-4909-8016-e32e1772807e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Flow 'volume_create_manager' (d70697a2-042a-4e50-8a2f-fd38a8ba1d01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:27:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:00 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-ffdf4efe-29e6-4131-bc10-6c4ddc92f3ee tempest-CreateVolumesFromSnapshotTest-1705705109 None] Created volume successfully. Jun 02 16:27:00 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:00 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:01 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.017s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:01 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:01 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-662e0059-1c73-4075-8c5c-d54b321dcc6d 1073741824" returned: 0 in 1.307s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-662e0059-1c73-4075-8c5c-d54b321dcc6d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:01 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-662e0059-1c73-4075-8c5c-d54b321dcc6d Jun 02 16:27:01 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:02 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-662e0059-1c73-4075-8c5c-d54b321dcc6d" returned: 0 in 0.678s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:27:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.635s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1581502346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9dc1b7d-2cec-44a3-994d-6e7ce05928e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34576647a2764f1f962eb20d378a01c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:26:57Z,use_quota=True,user_id='cd7cb8b784d14d6fb4a48e88c96948ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:27:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Creating volume d9dc1b7d-2cec-44a3-994d-6e7ce05928e9 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:27:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:27:02 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:27:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (908f54ae-a996-4cb3-b4b7-6f782a9f3db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662e0059-1c73-4075-8c5c-d54b321dcc6d', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:02 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9 1073741824 Jun 02 16:27:02 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844b0f84-d081-4976-a5d0-9b215813e69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:02 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume volume-662e0059-1c73-4075-8c5c-d54b321dcc6d (662e0059-1c73-4075-8c5c-d54b321dcc6d): created successfully Jun 02 16:27:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844b0f84-d081-4976-a5d0-9b215813e69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Flow 'volume_create_manager' (231bb025-bc43-4b2d-924e-683e6b79fa07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:02 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-b7f995f4-635b-4d86-adf3-77bbb6a66623 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Created volume successfully. Jun 02 16:27:03 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9 1073741824" returned: 0 in 1.265s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:03 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=103,cinder:UPDATE=100,cinder:INSERT=27,cinder:DELETE=6 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:27:03 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=87,cinder:UPDATE=123,cinder:INSERT=33,cinder:DELETE=9 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:27:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:03 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9 Jun 02 16:27:03 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:04 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9" returned: 0 in 0.671s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:27:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.221s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-192770021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65026e9-859c-44dd-ad9f-d470e777bf65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34576647a2764f1f962eb20d378a01c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:26:58Z,use_quota=True,user_id='cd7cb8b784d14d6fb4a48e88c96948ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:27:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Creating volume f65026e9-859c-44dd-ad9f-d470e777bf65 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:27:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:27:04 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:27:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f65026e9-859c-44dd-ad9f-d470e777bf65 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:04 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f65026e9-859c-44dd-ad9f-d470e777bf65 1073741824 Jun 02 16:27:04 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb565844-0307-46e0-a38e-77c215d37e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6441be63-593f-4798-ad52-cb0e3bd9a4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:04 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume volume-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9 (d9dc1b7d-2cec-44a3-994d-6e7ce05928e9): created successfully Jun 02 16:27:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6441be63-593f-4798-ad52-cb0e3bd9a4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Flow 'volume_create_manager' (edef3f60-4501-49da-a5ae-e447e027811a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:04 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-cc04ef5e-d469-4d74-aeef-c44cdfa539c9 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Created volume successfully. Jun 02 16:27:05 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f65026e9-859c-44dd-ad9f-d470e777bf65 1073741824" returned: 0 in 1.097s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Flow 'volume_create_manager' (3ccd57ff-5fcd-4314-b68a-4e8fca822633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e259b5-7a56-46d5-b3a6-d983565c9a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e259b5-7a56-46d5-b3a6-d983565c9a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-150820383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19486e1-a0d1-41ea-9889-ab41da6c290d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b558a05ea7a64c1e9d6ac1f72dc82def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:05Z,use_quota=True,user_id='3a8b2091152f4755bc5cea61b32188da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3db345-5bc2-461f-aa70-bdd9a4ba56a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3db345-5bc2-461f-aa70-bdd9a4ba56a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae9ebd9-b457-4da2-ba2f-a985f8a2d699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae9ebd9-b457-4da2-ba2f-a985f8a2d699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd19486e1-a0d1-41ea-9889-ab41da6c290d', 'volume_name': 'volume-d19486e1-a0d1-41ea-9889-ab41da6c290d', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fec178a-d3c5-457f-8b52-d54ef315236d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fec178a-d3c5-457f-8b52-d54ef315236d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeeadab6-66bc-4d5f-9569-10ac09c3399e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:05 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Volume d19486e1-a0d1-41ea-9889-ab41da6c290d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d19486e1-a0d1-41ea-9889-ab41da6c290d', 'volume_size': 1} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f65026e9-859c-44dd-ad9f-d470e777bf65 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:05 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f65026e9-859c-44dd-ad9f-d470e777bf65 Jun 02 16:27:05 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Flow 'volume_create_manager' (2818741b-2960-4478-ac57-a4da423f0206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fc84b8-ca7e-418e-a466-8bc7f90626d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fc84b8-ca7e-418e-a466-8bc7f90626d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1277159996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ab22b9-2ab7-44c3-87bd-b6a22a787879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b558a05ea7a64c1e9d6ac1f72dc82def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:06Z,use_quota=True,user_id='3a8b2091152f4755bc5cea61b32188da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f99de87-edbe-4d86-984f-0eed8aa5fbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f99de87-edbe-4d86-984f-0eed8aa5fbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e273d908-7e18-468d-8562-cdff4cef6ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e273d908-7e18-468d-8562-cdff4cef6ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9ab22b9-2ab7-44c3-87bd-b6a22a787879', 'volume_name': 'volume-b9ab22b9-2ab7-44c3-87bd-b6a22a787879', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ddf9ab-8d90-4bde-952b-113a04a1cd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ddf9ab-8d90-4bde-952b-113a04a1cd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c01629e-c5f4-4c0c-a96d-14019fefa7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:05 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Volume b9ab22b9-2ab7-44c3-87bd-b6a22a787879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9ab22b9-2ab7-44c3-87bd-b6a22a787879', 'volume_size': 1} Jun 02 16:27:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:27:06 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Flow 'volume_create_manager' (67f3daae-4290-43f1-a1f1-54dfa47e42ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a72f8da-880b-4af4-8c6b-18acb4367d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f65026e9-859c-44dd-ad9f-d470e777bf65" returned: 0 in 0.792s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.806s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-150820383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19486e1-a0d1-41ea-9889-ab41da6c290d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b558a05ea7a64c1e9d6ac1f72dc82def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:05Z,use_quota=True,user_id='3a8b2091152f4755bc5cea61b32188da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Creating volume d19486e1-a0d1-41ea-9889-ab41da6c290d {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:27:06 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d19486e1-a0d1-41ea-9889-ab41da6c290d 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a72f8da-880b-4af4-8c6b-18acb4367d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1540181102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ffeec3-a7f8-4e58-81c5-3257f4b6a358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b558a05ea7a64c1e9d6ac1f72dc82def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:06Z,use_quota=True,user_id='3a8b2091152f4755bc5cea61b32188da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ad17cf-5602-49b8-9fea-8271760cf1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ad17cf-5602-49b8-9fea-8271760cf1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:06 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d19486e1-a0d1-41ea-9889-ab41da6c290d 1073741824 Jun 02 16:27:06 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695e6ea5-313b-4af0-b266-b5fd4c307810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695e6ea5-313b-4af0-b266-b5fd4c307810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ffeec3-a7f8-4e58-81c5-3257f4b6a358', 'volume_name': 'volume-76ffeec3-a7f8-4e58-81c5-3257f4b6a358', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b226a2a-4619-4c4e-bf54-18de2da8f78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b226a2a-4619-4c4e-bf54-18de2da8f78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d1051b-2047-4d7d-bdd7-392fbbfff050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:06 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Volume 76ffeec3-a7f8-4e58-81c5-3257f4b6a358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ffeec3-a7f8-4e58-81c5-3257f4b6a358', 'volume_size': 1} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79683342-fccc-49a4-abe5-afaf60917031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f65026e9-859c-44dd-ad9f-d470e777bf65', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d53378f-ee14-4b97-9bb3-5e289bbf38a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:06 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Volume volume-f65026e9-859c-44dd-ad9f-d470e777bf65 (f65026e9-859c-44dd-ad9f-d470e777bf65): created successfully Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d53378f-ee14-4b97-9bb3-5e289bbf38a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Flow 'volume_create_manager' (5d65c05f-8d06-4c7b-aaa1-c0a01202be81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:06 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-b1d4e071-8ee6-4b49-b76c-3de5eb04f708 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Created volume successfully. Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Flow 'volume_create_manager' (b26e8f1c-8fa4-4791-9cbc-dbdbf4852480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce792b0f-a0f7-4ce7-981d-c568e0b87120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce792b0f-a0f7-4ce7-981d-c568e0b87120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1259905489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e7f342-230c-423f-8ae4-fe981953b580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b558a05ea7a64c1e9d6ac1f72dc82def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:06Z,use_quota=True,user_id='3a8b2091152f4755bc5cea61b32188da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23611437-578d-4818-834f-0da3647a89bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23611437-578d-4818-834f-0da3647a89bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc50ae8-4ec2-4257-b6be-69d0b9ecd9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc50ae8-4ec2-4257-b6be-69d0b9ecd9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4e7f342-230c-423f-8ae4-fe981953b580', 'volume_name': 'volume-e4e7f342-230c-423f-8ae4-fe981953b580', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5259ce64-8ed8-4c5c-afd4-95096e336874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5259ce64-8ed8-4c5c-afd4-95096e336874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8fbab1-0fcf-4e47-92cf-240aa635d490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:06 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Volume e4e7f342-230c-423f-8ae4-fe981953b580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4e7f342-230c-423f-8ae4-fe981953b580', 'volume_size': 1} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "cinder-f65026e9-859c-44dd-ad9f-d470e777bf65-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-f65026e9-859c-44dd-ad9f-d470e777bf65-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "cinder-quobyte-f65026e9-859c-44dd-ad9f-d470e777bf65" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-quobyte-f65026e9-859c-44dd-ad9f-d470e777bf65" acquired by "delete_volume" :: waited 0.025s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ccb53f-2432-4bbb-943d-2a3cec16fe4a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f65026e9-859c-44dd-ad9f-d470e777bf65 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:07 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:27:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Flow 'volume_create_manager' (0ebb445a-eeb1-4eeb-9d48-3aaa4818fd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37786148-fae9-466f-ae01-42eed3e077ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37786148-fae9-466f-ae01-42eed3e077ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1577614988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259f5233-4750-4abc-a04a-8f6e4a7a59b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b558a05ea7a64c1e9d6ac1f72dc82def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:07Z,use_quota=True,user_id='3a8b2091152f4755bc5cea61b32188da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e62ef3-1d5f-4de7-86e8-45a6f00373f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e62ef3-1d5f-4de7-86e8-45a6f00373f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a147347d-f032-4f87-8936-8602fba2d66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a147347d-f032-4f87-8936-8602fba2d66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '259f5233-4750-4abc-a04a-8f6e4a7a59b7', 'volume_name': 'volume-259f5233-4750-4abc-a04a-8f6e4a7a59b7', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15df6b14-76e6-4991-9fb9-66fd40283a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15df6b14-76e6-4991-9fb9-66fd40283a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d3bb01-e986-48e1-81d0-86b390f56450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:07 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Volume 259f5233-4750-4abc-a04a-8f6e4a7a59b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-259f5233-4750-4abc-a04a-8f6e4a7a59b7', 'volume_size': 1} Jun 02 16:27:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:07 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f65026e9-859c-44dd-ad9f-d470e777bf65 Jun 02 16:27:07 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:07 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d19486e1-a0d1-41ea-9889-ab41da6c290d 1073741824" returned: 0 in 1.196s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d19486e1-a0d1-41ea-9889-ab41da6c290d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:07 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d19486e1-a0d1-41ea-9889-ab41da6c290d Jun 02 16:27:07 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:07 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f65026e9-859c-44dd-ad9f-d470e777bf65" returned: 0 in 0.816s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f65026e9-859c-44dd-ad9f-d470e777bf65 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:07 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f65026e9-859c-44dd-ad9f-d470e777bf65 Jun 02 16:27:07 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:08 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d19486e1-a0d1-41ea-9889-ab41da6c290d" returned: 0 in 0.701s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.299s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1277159996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ab22b9-2ab7-44c3-87bd-b6a22a787879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b558a05ea7a64c1e9d6ac1f72dc82def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:06Z,use_quota=True,user_id='3a8b2091152f4755bc5cea61b32188da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Creating volume b9ab22b9-2ab7-44c3-87bd-b6a22a787879 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:27:08 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9ab22b9-2ab7-44c3-87bd-b6a22a787879 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeeadab6-66bc-4d5f-9569-10ac09c3399e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d19486e1-a0d1-41ea-9889-ab41da6c290d', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07fbf43-2eab-40bc-bd4b-9133f21990db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:08 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9ab22b9-2ab7-44c3-87bd-b6a22a787879 1073741824 Jun 02 16:27:08 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:08 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Volume volume-d19486e1-a0d1-41ea-9889-ab41da6c290d (d19486e1-a0d1-41ea-9889-ab41da6c290d): created successfully Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07fbf43-2eab-40bc-bd4b-9133f21990db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Flow 'volume_create_manager' (3ccd57ff-5fcd-4314-b68a-4e8fca822633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:08 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-212f7556-4c90-4ffc-a05d-25eb5d7fc740 tempest-CreateVolumesFromImageTest-759422402 None] Created volume successfully. Jun 02 16:27:08 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-f65026e9-859c-44dd-ad9f-d470e777bf65" returned: 0 in 0.711s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-quobyte-f65026e9-859c-44dd-ad9f-d470e777bf65" released by "delete_volume" :: held 1.601s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Created reservations ['a3944c99-857d-4acf-b022-415003008504', '87e1aef6-ec0a-4f3a-8202-f56a543d5052', '59500c4c-8ab3-4812-b17a-078a8461e180', '8cba5041-a50a-4dea-8545-8be295fcb446'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:08 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:08 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:08 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9ab22b9-2ab7-44c3-87bd-b6a22a787879 1073741824" returned: 0 in 0.883s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9ab22b9-2ab7-44c3-87bd-b6a22a787879 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:09 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9ab22b9-2ab7-44c3-87bd-b6a22a787879 Jun 02 16:27:09 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "cinder-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "cinder-quobyte-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-quobyte-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9" acquired by "delete_volume" :: waited 0.026s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b5560a-981c-46aa-898f-1f0cc10037ee]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:09 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.779s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:09 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Deleted volume successfully. Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b99c102d-5bca-4fca-8f34-1546a5b23980 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-f65026e9-859c-44dd-ad9f-d470e777bf65-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:09 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9 Jun 02 16:27:09 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:09 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9ab22b9-2ab7-44c3-87bd-b6a22a787879" returned: 0 in 0.702s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.520s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1540181102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ffeec3-a7f8-4e58-81c5-3257f4b6a358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b558a05ea7a64c1e9d6ac1f72dc82def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:06Z,use_quota=True,user_id='3a8b2091152f4755bc5cea61b32188da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Creating volume 76ffeec3-a7f8-4e58-81c5-3257f4b6a358 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:27:09 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-76ffeec3-a7f8-4e58-81c5-3257f4b6a358 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c01629e-c5f4-4c0c-a96d-14019fefa7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ab22b9-2ab7-44c3-87bd-b6a22a787879', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:09 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-76ffeec3-a7f8-4e58-81c5-3257f4b6a358 1073741824 Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702f076c-5b2e-4487-884f-1ff7d35c8276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:09 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:09 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Volume volume-b9ab22b9-2ab7-44c3-87bd-b6a22a787879 (b9ab22b9-2ab7-44c3-87bd-b6a22a787879): created successfully Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702f076c-5b2e-4487-884f-1ff7d35c8276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:09 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Flow 'volume_create_manager' (2818741b-2960-4478-ac57-a4da423f0206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:09 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f33ba651-0deb-4583-a1e5-7b62a5674b08 tempest-CreateVolumesFromImageTest-759422402 None] Created volume successfully. Jun 02 16:27:10 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9" returned: 0 in 1.089s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:10 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9 Jun 02 16:27:10 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:10 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-76ffeec3-a7f8-4e58-81c5-3257f4b6a358 1073741824" returned: 0 in 1.130s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-76ffeec3-a7f8-4e58-81c5-3257f4b6a358 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:10 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-76ffeec3-a7f8-4e58-81c5-3257f4b6a358 Jun 02 16:27:10 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:11 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9" returned: 0 in 0.672s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-quobyte-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9" released by "delete_volume" :: held 1.826s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Created reservations ['6b1605e3-5279-418e-9382-889192ecc31d', '1d1c51fe-5a24-4364-b83d-bbf471846230', 'f0c8ef73-9367-4378-bfe0-5158c6bb94fb', '8f7060ad-1f5d-4bae-84ed-236827a75e10'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:11 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:11 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "cinder-662e0059-1c73-4075-8c5c-d54b321dcc6d-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-662e0059-1c73-4075-8c5c-d54b321dcc6d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:11 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "cinder-quobyte-662e0059-1c73-4075-8c5c-d54b321dcc6d" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-76ffeec3-a7f8-4e58-81c5-3257f4b6a358" returned: 0 in 0.759s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.086s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1259905489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e7f342-230c-423f-8ae4-fe981953b580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b558a05ea7a64c1e9d6ac1f72dc82def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:06Z,use_quota=True,user_id='3a8b2091152f4755bc5cea61b32188da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Creating volume e4e7f342-230c-423f-8ae4-fe981953b580 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:27:11 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4e7f342-230c-423f-8ae4-fe981953b580 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d1051b-2047-4d7d-bdd7-392fbbfff050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ffeec3-a7f8-4e58-81c5-3257f4b6a358', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (decdfa28-8b0b-4a8f-8cb0-5c830469bb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-quobyte-662e0059-1c73-4075-8c5c-d54b321dcc6d" acquired by "delete_volume" :: waited 0.065s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:11 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4e7f342-230c-423f-8ae4-fe981953b580 1073741824 Jun 02 16:27:11 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:11 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Volume volume-76ffeec3-a7f8-4e58-81c5-3257f4b6a358 (76ffeec3-a7f8-4e58-81c5-3257f4b6a358): created successfully Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (decdfa28-8b0b-4a8f-8cb0-5c830469bb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Flow 'volume_create_manager' (67f3daae-4290-43f1-a1f1-54dfa47e42ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5542d602-f8e6-4bcb-a565-cdb53598fbce]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-662e0059-1c73-4075-8c5c-d54b321dcc6d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:11 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9826cba9-e15e-4a91-bf76-6f2da1352936 tempest-CreateVolumesFromImageTest-759422402 None] Created volume successfully. Jun 02 16:27:11 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-662e0059-1c73-4075-8c5c-d54b321dcc6d Jun 02 16:27:11 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:12 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.741s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:12 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:12 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Deleted volume successfully. Jun 02 16:27:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1411cf6-508b-48d9-a548-35737ade02c0 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-d9dc1b7d-2cec-44a3-994d-6e7ce05928e9-delete_volume" released by "delete_volume" :: held 2.857s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:12 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-662e0059-1c73-4075-8c5c-d54b321dcc6d" returned: 0 in 0.942s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-662e0059-1c73-4075-8c5c-d54b321dcc6d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:12 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-662e0059-1c73-4075-8c5c-d54b321dcc6d Jun 02 16:27:12 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:12 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4e7f342-230c-423f-8ae4-fe981953b580 1073741824" returned: 0 in 1.101s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4e7f342-230c-423f-8ae4-fe981953b580 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:12 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4e7f342-230c-423f-8ae4-fe981953b580 Jun 02 16:27:12 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:13 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-662e0059-1c73-4075-8c5c-d54b321dcc6d" returned: 0 in 0.642s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-quobyte-662e0059-1c73-4075-8c5c-d54b321dcc6d" released by "delete_volume" :: held 1.653s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] Created reservations ['60f27dab-ddbb-42a9-be96-286389c2f126', '3f6cf1d8-5187-44d6-8736-2f49403416cb', '1aebb99e-9a4d-4c1c-871f-e18843388440', '5e23fcd2-7eae-453d-ab18-4544f742e08e'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:13 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4e7f342-230c-423f-8ae4-fe981953b580" returned: 0 in 0.696s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.411s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1577614988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259f5233-4750-4abc-a04a-8f6e4a7a59b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b558a05ea7a64c1e9d6ac1f72dc82def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:07Z,use_quota=True,user_id='3a8b2091152f4755bc5cea61b32188da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Creating volume 259f5233-4750-4abc-a04a-8f6e4a7a59b7 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:27:13 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-259f5233-4750-4abc-a04a-8f6e4a7a59b7 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:13 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:13 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8fbab1-0fcf-4e47-92cf-240aa635d490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4e7f342-230c-423f-8ae4-fe981953b580', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48db2d2-ab57-4b80-9983-94dff99e8e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:13 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-259f5233-4750-4abc-a04a-8f6e4a7a59b7 1073741824 Jun 02 16:27:13 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:13 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Volume volume-e4e7f342-230c-423f-8ae4-fe981953b580 (e4e7f342-230c-423f-8ae4-fe981953b580): created successfully Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48db2d2-ab57-4b80-9983-94dff99e8e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Flow 'volume_create_manager' (b26e8f1c-8fa4-4791-9cbc-dbdbf4852480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:13 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-1efdb842-cac3-4286-9ecd-05356259686f tempest-CreateVolumesFromImageTest-759422402 None] Created volume successfully. Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "cinder-79e91acd-a30a-4fbb-9319-56dd68adb875-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-79e91acd-a30a-4fbb-9319-56dd68adb875-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "cinder-quobyte-79e91acd-a30a-4fbb-9319-56dd68adb875" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-quobyte-79e91acd-a30a-4fbb-9319-56dd68adb875" acquired by "delete_volume" :: waited 0.035s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:14 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ae54e1-b3ff-45b4-87e2-01d70fe6b891]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-79e91acd-a30a-4fbb-9319-56dd68adb875 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:14 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-79e91acd-a30a-4fbb-9319-56dd68adb875 Jun 02 16:27:14 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:14 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.809s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:14 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:14 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] Deleted volume successfully. Jun 02 16:27:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-dea4ebae-b8a3-4462-a0f8-d057ffb492bc tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-662e0059-1c73-4075-8c5c-d54b321dcc6d-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:14 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-259f5233-4750-4abc-a04a-8f6e4a7a59b7 1073741824" returned: 0 in 1.044s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-259f5233-4750-4abc-a04a-8f6e4a7a59b7 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:14 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-259f5233-4750-4abc-a04a-8f6e4a7a59b7 Jun 02 16:27:14 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:14 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-79e91acd-a30a-4fbb-9319-56dd68adb875" returned: 0 in 0.917s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-79e91acd-a30a-4fbb-9319-56dd68adb875 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:15 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-79e91acd-a30a-4fbb-9319-56dd68adb875 Jun 02 16:27:15 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:15 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-259f5233-4750-4abc-a04a-8f6e4a7a59b7" returned: 0 in 0.690s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:15 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:27:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:15 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d3bb01-e986-48e1-81d0-86b390f56450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-259f5233-4750-4abc-a04a-8f6e4a7a59b7', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:15 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e132218-4305-4468-b5ea-d9d6458830f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:15 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Volume volume-259f5233-4750-4abc-a04a-8f6e4a7a59b7 (259f5233-4750-4abc-a04a-8f6e4a7a59b7): created successfully Jun 02 16:27:15 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e132218-4305-4468-b5ea-d9d6458830f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:15 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Flow 'volume_create_manager' (0ebb445a-eeb1-4eeb-9d48-3aaa4818fd3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:15 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-4a297ffb-5d69-4cbb-b9d7-fe4f0c154844 tempest-CreateVolumesFromImageTest-759422402 None] Created volume successfully. Jun 02 16:27:15 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-79e91acd-a30a-4fbb-9319-56dd68adb875" returned: 0 in 0.694s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-quobyte-79e91acd-a30a-4fbb-9319-56dd68adb875" released by "delete_volume" :: held 1.678s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:15 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Created reservations ['faced0ba-64e8-45e6-8f43-704c1b4d37f8', '25d03a08-62fd-47d1-ade7-eac64ceb6864', 'f19ab039-9cd2-4c73-aa1a-b3a33e3571d5', 'e5296fc1-446a-4b2f-9429-763d41dbc9a5'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:15 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:15 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:15 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:15 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "cinder-259f5233-4750-4abc-a04a-8f6e4a7a59b7-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-259f5233-4750-4abc-a04a-8f6e4a7a59b7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "cinder-quobyte-259f5233-4750-4abc-a04a-8f6e4a7a59b7" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-quobyte-259f5233-4750-4abc-a04a-8f6e4a7a59b7" acquired by "delete_volume" :: waited 0.025s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:16 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c933fa3-77b8-46da-b332-03c81239d4ab]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-259f5233-4750-4abc-a04a-8f6e4a7a59b7 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "cinder-a0ef7db7-17b9-448c-9236-457b3e95f49b-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-a0ef7db7-17b9-448c-9236-457b3e95f49b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "cinder-quobyte-a0ef7db7-17b9-448c-9236-457b3e95f49b" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-quobyte-a0ef7db7-17b9-448c-9236-457b3e95f49b" acquired by "delete_volume" :: waited 0.027s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:16 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-259f5233-4750-4abc-a04a-8f6e4a7a59b7 Jun 02 16:27:16 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:16 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fe9958-ede3-4b4d-869d-dfb9ec15d048]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a0ef7db7-17b9-448c-9236-457b3e95f49b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:16 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a0ef7db7-17b9-448c-9236-457b3e95f49b Jun 02 16:27:16 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:16 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.932s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:16 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:16 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Deleted volume successfully. Jun 02 16:27:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-fa0792a6-1f34-48c2-af95-1679618a2395 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-79e91acd-a30a-4fbb-9319-56dd68adb875-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:17 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-259f5233-4750-4abc-a04a-8f6e4a7a59b7" returned: 0 in 1.075s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-259f5233-4750-4abc-a04a-8f6e4a7a59b7 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:17 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-259f5233-4750-4abc-a04a-8f6e4a7a59b7 Jun 02 16:27:17 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:17 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a0ef7db7-17b9-448c-9236-457b3e95f49b" returned: 0 in 0.938s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a0ef7db7-17b9-448c-9236-457b3e95f49b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:17 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a0ef7db7-17b9-448c-9236-457b3e95f49b Jun 02 16:27:17 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:17 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-259f5233-4750-4abc-a04a-8f6e4a7a59b7" returned: 0 in 0.699s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-quobyte-259f5233-4750-4abc-a04a-8f6e4a7a59b7" released by "delete_volume" :: held 1.847s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:17 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] Created reservations ['665fb23e-9b55-4955-b6a7-67ca00149a29', '3c484977-940d-4d64-83d7-e707095997bb', '7e7821cb-9c56-4911-907e-bed1ca01738a', '52d46383-b173-4c0a-bb71-6375512ca262'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:17 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a0ef7db7-17b9-448c-9236-457b3e95f49b" returned: 0 in 0.690s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-quobyte-a0ef7db7-17b9-448c-9236-457b3e95f49b" released by "delete_volume" :: held 1.690s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Created reservations ['553ffd4d-9b39-450d-9255-fba6558c23d1', '329fd595-d3b6-46c4-9a03-98e98e9f18a7', '033d3cf0-fb08-4d20-8a0a-681c11a79226', 'f0a3cfe8-e62d-4385-9d1b-798003438995'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:18 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:18 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:18 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:18 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "cinder-e4e7f342-230c-423f-8ae4-fe981953b580-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-e4e7f342-230c-423f-8ae4-fe981953b580-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "cinder-quobyte-e4e7f342-230c-423f-8ae4-fe981953b580" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-quobyte-e4e7f342-230c-423f-8ae4-fe981953b580" acquired by "delete_volume" :: waited 0.024s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65c077b-1ebe-4aa6-9c15-5c9621d747cc]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4e7f342-230c-423f-8ae4-fe981953b580 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "cinder-b78a59c0-c686-470b-b0b3-93ad9c2f7725-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-b78a59c0-c686-470b-b0b3-93ad9c2f7725-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "cinder-quobyte-e235db06-44bc-4109-a76d-efa855acf120" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-quobyte-e235db06-44bc-4109-a76d-efa855acf120" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "cinder-quobyte-b78a59c0-c686-470b-b0b3-93ad9c2f7725" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-quobyte-b78a59c0-c686-470b-b0b3-93ad9c2f7725" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Deleting offline snapshot b78a59c0-c686-470b-b0b3-93ad9c2f7725 of volume e235db06-44bc-4109-a76d-efa855acf120 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:27:18 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4e7f342-230c-423f-8ae4-fe981953b580 Jun 02 16:27:18 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] snapshot_file for this snap is: volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5f0077-3ea6-498c-90f1-53e15c69cbea]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:18 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725 Jun 02 16:27:18 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:19 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.198s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:19 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:19 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.082s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:19 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:19 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] Deleted volume successfully. Jun 02 16:27:19 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Deleted volume successfully. Jun 02 16:27:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bbcc4c6e-9867-4181-93f1-7ad80e95a35f tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-259f5233-4750-4abc-a04a-8f6e4a7a59b7-delete_volume" released by "delete_volume" :: held 3.368s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9f6e6401-4d59-487c-bf56-2329caa49bf1 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-a0ef7db7-17b9-448c-9236-457b3e95f49b-delete_volume" released by "delete_volume" :: held 3.159s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:19 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4e7f342-230c-423f-8ae4-fe981953b580" returned: 0 in 1.170s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4e7f342-230c-423f-8ae4-fe981953b580 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:19 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4e7f342-230c-423f-8ae4-fe981953b580 Jun 02 16:27:19 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:19 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725" returned: 0 in 0.997s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e235db06-44bc-4109-a76d-efa855acf120(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:27:19 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[724da0fe-56e3-4c9a-a5df-6d0023296268]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:19 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120 Jun 02 16:27:19 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:20 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e4e7f342-230c-423f-8ae4-fe981953b580" returned: 0 in 0.651s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-quobyte-e4e7f342-230c-423f-8ae4-fe981953b580" released by "delete_volume" :: held 1.877s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:20 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] Created reservations ['40dbcc3e-460c-4464-9d76-b047a2fbbae1', '55d3564d-8bbb-4112-b591-ef82669c5baa', 'f6aa2e3e-30fd-4a13-b648-483c71ad610b', 'a4fbbe8a-5ab8-49cb-a0e2-a8d364002480'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:20 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:20 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:20 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120" returned: 0 in 0.901s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:20 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725 Jun 02 16:27:20 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "cinder-76ffeec3-a7f8-4e58-81c5-3257f4b6a358-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-76ffeec3-a7f8-4e58-81c5-3257f4b6a358-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "cinder-quobyte-76ffeec3-a7f8-4e58-81c5-3257f4b6a358" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-quobyte-76ffeec3-a7f8-4e58-81c5-3257f4b6a358" acquired by "delete_volume" :: waited 0.030s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:20 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b478d98b-76ec-4985-a9c1-dafc7ee56f83]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-76ffeec3-a7f8-4e58-81c5-3257f4b6a358 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:20 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-76ffeec3-a7f8-4e58-81c5-3257f4b6a358 Jun 02 16:27:20 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:21 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.699s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:21 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:21 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] Deleted volume successfully. Jun 02 16:27:21 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-21ee9899-758c-4f8d-8fc1-fe3dba8aa796 tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-e4e7f342-230c-423f-8ae4-fe981953b580-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:21 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725" returned: 0 in 0.854s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:21 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725 Jun 02 16:27:21 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:21 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-76ffeec3-a7f8-4e58-81c5-3257f4b6a358" returned: 0 in 0.896s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-76ffeec3-a7f8-4e58-81c5-3257f4b6a358 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:21 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-76ffeec3-a7f8-4e58-81c5-3257f4b6a358 Jun 02 16:27:21 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:22 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120.b78a59c0-c686-470b-b0b3-93ad9c2f7725" returned: 0 in 0.629s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-quobyte-b78a59c0-c686-470b-b0b3-93ad9c2f7725" released by "_delete_snapshot" :: held 3.529s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-quobyte-e235db06-44bc-4109-a76d-efa855acf120" released by "delete_snapshot" :: held 3.564s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Created reservations ['6b73f5c8-d5d2-435e-bcb8-e63185d5ca09', '5d26d68a-1519-4866-b0fa-fa2dce3fbf9d', '91028c27-e683-4050-a5f4-1cc6304432ae', 'd753063b-41b7-414e-a7ab-0789c8298734'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:22 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Delete snapshot completed successfully. Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1ce86d1-61c5-4668-828e-0d3e9b4c72f5 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-b78a59c0-c686-470b-b0b3-93ad9c2f7725-delete_snapshot" released by "delete_snapshot" :: held 3.752s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:22 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-76ffeec3-a7f8-4e58-81c5-3257f4b6a358" returned: 0 in 0.708s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-quobyte-76ffeec3-a7f8-4e58-81c5-3257f4b6a358" released by "delete_volume" :: held 1.661s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] Created reservations ['32aa4ce0-4682-487e-9bd4-455a1954a759', '671ed913-7892-4a88-950b-662126d90f67', '6c0d53d3-80ff-469d-8f8d-7655f638c647', '2edfb3f7-0ace-4615-9e00-ec8d31fe54ad'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:22 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:22 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "cinder-e235db06-44bc-4109-a76d-efa855acf120-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-e235db06-44bc-4109-a76d-efa855acf120-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "cinder-quobyte-e235db06-44bc-4109-a76d-efa855acf120" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-quobyte-e235db06-44bc-4109-a76d-efa855acf120" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8c9698-a4c1-4b34-afd2-e9eb569f6e5d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "cinder-b9ab22b9-2ab7-44c3-87bd-b6a22a787879-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:23 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120 Jun 02 16:27:23 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-b9ab22b9-2ab7-44c3-87bd-b6a22a787879-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "cinder-quobyte-b9ab22b9-2ab7-44c3-87bd-b6a22a787879" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-quobyte-b9ab22b9-2ab7-44c3-87bd-b6a22a787879" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:23 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39a392d-ba9a-4b78-bbda-731271d2a0e0]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9ab22b9-2ab7-44c3-87bd-b6a22a787879 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:23 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.622s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:23 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:23 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] Deleted volume successfully. Jun 02 16:27:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-830c46be-522f-4123-9b30-57c015667c34 tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-76ffeec3-a7f8-4e58-81c5-3257f4b6a358-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:23 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9ab22b9-2ab7-44c3-87bd-b6a22a787879 Jun 02 16:27:23 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:23 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120" returned: 0 in 0.851s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:23 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120 Jun 02 16:27:23 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:23 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9ab22b9-2ab7-44c3-87bd-b6a22a787879" returned: 0 in 0.799s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9ab22b9-2ab7-44c3-87bd-b6a22a787879 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:24 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9ab22b9-2ab7-44c3-87bd-b6a22a787879 Jun 02 16:27:24 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:24 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e235db06-44bc-4109-a76d-efa855acf120" returned: 0 in 0.630s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-quobyte-e235db06-44bc-4109-a76d-efa855acf120" released by "delete_volume" :: held 1.544s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Created reservations ['e5845ab0-afba-48c8-ae68-868349cf30f4', '3e9382c8-9c26-4d24-860b-7f86d2f8ee50', '4c605125-ad84-4abd-9a20-69ef5aa9d4fb', '4ccf8336-b844-459a-8131-7852d61b884c'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:24 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:24 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:24 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b9ab22b9-2ab7-44c3-87bd-b6a22a787879" returned: 0 in 0.655s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-quobyte-b9ab22b9-2ab7-44c3-87bd-b6a22a787879" released by "delete_volume" :: held 1.509s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] Created reservations ['906512aa-aa01-439e-9f80-67458cb90897', 'daeecbf6-eaf0-46a1-9893-d8fb3040c129', '7693195e-0c6d-41fc-a02e-f090b83eafae', 'bbd024b3-9eb0-4903-9634-6408a200dea7'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:24 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:24 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:25 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "cinder-d19486e1-a0d1-41ea-9889-ab41da6c290d-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.808s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:25 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:25 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Deleted volume successfully. Jun 02 16:27:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-d19486e1-a0d1-41ea-9889-ab41da6c290d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52696a83-8888-4e5b-8d25-e89964eade06 tempest-CreateVolumesFromSnapshotTest-1705705109 None] Lock "cinder-e235db06-44bc-4109-a76d-efa855acf120-delete_volume" released by "delete_volume" :: held 2.607s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "cinder-quobyte-d19486e1-a0d1-41ea-9889-ab41da6c290d" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-quobyte-d19486e1-a0d1-41ea-9889-ab41da6c290d" acquired by "delete_volume" :: waited 0.017s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:25 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c35be06-520b-45e5-9dc8-9170e37aaad1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d19486e1-a0d1-41ea-9889-ab41da6c290d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:25 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.789s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:25 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:25 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] Deleted volume successfully. Jun 02 16:27:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-91ddaf28-2bfd-4857-9f71-ff55a8e28ebf tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-b9ab22b9-2ab7-44c3-87bd-b6a22a787879-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:25 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d19486e1-a0d1-41ea-9889-ab41da6c290d Jun 02 16:27:25 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:26 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d19486e1-a0d1-41ea-9889-ab41da6c290d" returned: 0 in 0.822s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d19486e1-a0d1-41ea-9889-ab41da6c290d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:26 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d19486e1-a0d1-41ea-9889-ab41da6c290d Jun 02 16:27:26 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:27 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d19486e1-a0d1-41ea-9889-ab41da6c290d" returned: 0 in 0.696s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:27 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-quobyte-d19486e1-a0d1-41ea-9889-ab41da6c290d" released by "delete_volume" :: held 1.575s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:27 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] Created reservations ['9a0ffacf-84dd-460a-b146-817d401fb8e5', 'd7188ac5-1606-4901-9aa8-d43b2f4d79fa', 'aadec43d-ec76-4bbe-99d2-28e4a6871e44', 'e201cb74-b995-4d6c-8ebd-ecf8d59ae557'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:27 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:27 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:27 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:27 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:28 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.845s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:28 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:28 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] Deleted volume successfully. Jun 02 16:27:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-52a63ad6-f896-482b-b0e4-c70e9707f803 tempest-CreateVolumesFromImageTest-759422402 None] Lock "cinder-d19486e1-a0d1-41ea-9889-ab41da6c290d-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Flow 'volume_create_manager' (22040170-c80a-48e3-8b5b-0250e0418c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d28dd4d-a6e3-4e7d-b54c-d2dd8044cd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d28dd4d-a6e3-4e7d-b54c-d2dd8044cd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1949260600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00532cd-d97a-4238-8078-02e1477ae921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5235b6b27a924047b3d3351ec724c3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:31Z,use_quota=True,user_id='d27574c10de94169b392018b3454ffb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043dd0b3-8c55-4457-9574-78be9fdbd4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043dd0b3-8c55-4457-9574-78be9fdbd4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad43619c-5330-421b-8a12-145ba1371adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad43619c-5330-421b-8a12-145ba1371adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c00532cd-d97a-4238-8078-02e1477ae921', 'volume_name': 'volume-c00532cd-d97a-4238-8078-02e1477ae921', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d7a7f0-61fa-484a-b69d-42827807a253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d7a7f0-61fa-484a-b69d-42827807a253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4c7431-d2b6-4484-bb99-12da757727bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:31 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume c00532cd-d97a-4238-8078-02e1477ae921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c00532cd-d97a-4238-8078-02e1477ae921', 'volume_size': 1} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1949260600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00532cd-d97a-4238-8078-02e1477ae921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5235b6b27a924047b3d3351ec724c3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:31Z,use_quota=True,user_id='d27574c10de94169b392018b3454ffb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Creating volume c00532cd-d97a-4238-8078-02e1477ae921 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:27:31 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c00532cd-d97a-4238-8078-02e1477ae921 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:31 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c00532cd-d97a-4238-8078-02e1477ae921 1073741824 Jun 02 16:27:31 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Flow 'volume_create_manager' (cceae020-d7b4-4169-8433-89b49067344d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b30709fb-1115-4204-8f6f-75ad1170d833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b30709fb-1115-4204-8f6f-75ad1170d833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198c4bc5-105f-4b44-8bf8-a7d7772b887b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='242ef46ecb8b45dfadafd7709fa3853d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:32Z,use_quota=True,user_id='4da4c97e1790426d94c83ec419bf3564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8923a27-2043-4e02-81ce-c5df8887a85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:31 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8923a27-2043-4e02-81ce-c5df8887a85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f785003-9e1f-4146-b68b-7bbe2fd6f034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG cinder.image.glance [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Creating Keystone auth plugin from conf {{(pid=86488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 16:27:32 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c00532cd-d97a-4238-8078-02e1477ae921 1073741824" returned: 0 in 0.929s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c00532cd-d97a-4238-8078-02e1477ae921 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:32 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c00532cd-d97a-4238-8078-02e1477ae921 Jun 02 16:27:32 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f785003-9e1f-4146-b68b-7bbe2fd6f034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '198c4bc5-105f-4b44-8bf8-a7d7772b887b', 'volume_name': 'volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b', 'volume_size': 1, 'image_id': '3928a120-f2df-44ce-85c4-60fa5423f446', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3928a120-f2df-44ce-85c4-60fa5423f446', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16135206ce5123f4511171f76ff59304', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '242ef46ecb8b45dfadafd7709fa3853d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5631429c75a60e604e12a37521ccd57ade7960ded14c59e8e84bca71bcdbaa1089069eefb188e6270cf21665d43c6f14ec5825e89776ccabdab5a4f8ea52dd70', 'id': '3928a120-f2df-44ce-85c4-60fa5423f446', 'created_at': datetime.datetime(2026, 6, 2, 14, 27, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 27, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3928a120-f2df-44ce-85c4-60fa5423f446/file', 'properties': {}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f2f91f-13a9-4d39-80f8-ec661852c72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f2f91f-13a9-4d39-80f8-ec661852c72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da21b8c6-8192-453c-9e12-fd2d3bd2541f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:32 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Volume 198c4bc5-105f-4b44-8bf8-a7d7772b887b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b', 'volume_size': 1, 'image_id': '3928a120-f2df-44ce-85c4-60fa5423f446', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3928a120-f2df-44ce-85c4-60fa5423f446', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16135206ce5123f4511171f76ff59304', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '242ef46ecb8b45dfadafd7709fa3853d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5631429c75a60e604e12a37521ccd57ade7960ded14c59e8e84bca71bcdbaa1089069eefb188e6270cf21665d43c6f14ec5825e89776ccabdab5a4f8ea52dd70', 'id': '3928a120-f2df-44ce-85c4-60fa5423f446', 'created_at': datetime.datetime(2026, 6, 2, 14, 27, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 27, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3928a120-f2df-44ce-85c4-60fa5423f446/file', 'properties': {}}, 'image_service': } Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Trying to clone 198c4bc5-105f-4b44-8bf8-a7d7772b887b from image 3928a120-f2df-44ce-85c4-60fa5423f446 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3928a120-f2df-44ce-85c4-60fa5423f446', 'metadata': {}}]). {{(pid=86488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 16:27:32 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Image download 0.00 MB at 0.00 MB/s Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5382b43a-58c2-433a-87a7-f4fc74b5b099]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:32 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD Jun 02 16:27:32 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:32 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c00532cd-d97a-4238-8078-02e1477ae921" returned: 0 in 0.641s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4c7431-d2b6-4484-bb99-12da757727bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c00532cd-d97a-4238-8078-02e1477ae921', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd51a58-438c-4f8d-905b-7b63b916fb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:32 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume volume-c00532cd-d97a-4238-8078-02e1477ae921 (c00532cd-d97a-4238-8078-02e1477ae921): created successfully Jun 02 16:27:32 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd51a58-438c-4f8d-905b-7b63b916fb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Flow 'volume_create_manager' (22040170-c80a-48e3-8b5b-0250e0418c90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:33 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-3dfe83e0-f883-47fb-bcf9-97e577b5db21 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Created volume successfully. Jun 02 16:27:33 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:33 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD Jun 02 16:27:33 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Flow 'volume_create_manager' (931e16da-e762-4353-87b7-2deb1c57aae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008748ac-2e3e-4170-8380-1452e28e9bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008748ac-2e3e-4170-8380-1452e28e9bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-325177931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fd23e7-801d-40df-845c-7ab033288df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5235b6b27a924047b3d3351ec724c3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:34Z,use_quota=True,user_id='d27574c10de94169b392018b3454ffb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efec5a30-5739-4cfe-a55b-3c1495aee346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efec5a30-5739-4cfe-a55b-3c1495aee346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fde104-6b5b-44db-9e33-1c707813b102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fde104-6b5b-44db-9e33-1c707813b102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04fd23e7-801d-40df-845c-7ab033288df9', 'volume_name': 'volume-04fd23e7-801d-40df-845c-7ab033288df9', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0280db58-dd09-4e20-be82-eb389c25f365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0280db58-dd09-4e20-be82-eb389c25f365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0e652b-db92-4684-bc9a-c012ef38f800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:33 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume 04fd23e7-801d-40df-845c-7ab033288df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04fd23e7-801d-40df-845c-7ab033288df9', 'volume_size': 1} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-325177931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fd23e7-801d-40df-845c-7ab033288df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5235b6b27a924047b3d3351ec724c3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:34Z,use_quota=True,user_id='d27574c10de94169b392018b3454ffb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Creating volume 04fd23e7-801d-40df-845c-7ab033288df9 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:27:33 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:27:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-04fd23e7-801d-40df-845c-7ab033288df9 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:33 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-04fd23e7-801d-40df-845c-7ab033288df9 1073741824 Jun 02 16:27:33 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:33 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD" returned: 1 in 0.765s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Temporary image 3928a120-f2df-44ce-85c4-60fa5423f446 is fetched for user 4da4c97e1790426d94c83ec419bf3564. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17fb5ec-2409-4124-a8d1-39f7b4cba98e]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Flow 'volume_create_manager' (92e26798-dbe8-40dd-a071-b1e0b727fdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a4a72ba-e0cb-4f69-aaa9-5899e86183ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a4a72ba-e0cb-4f69-aaa9-5899e86183ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1483254707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01decb7-388c-43e1-90fb-552d2b9adc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5235b6b27a924047b3d3351ec724c3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:34Z,use_quota=True,user_id='d27574c10de94169b392018b3454ffb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc4431e9-e47e-448b-9f0c-f3ea2e974455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc4431e9-e47e-448b-9f0c-f3ea2e974455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:34 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8874f5-8aa9-4d4f-ae15-e9c7636a4443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:34 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8874f5-8aa9-4d4f-ae15-e9c7636a4443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e01decb7-388c-43e1-90fb-552d2b9adc59', 'volume_name': 'volume-e01decb7-388c-43e1-90fb-552d2b9adc59', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b9c046-271a-4543-88cd-af53e6122a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b9c046-271a-4543-88cd-af53e6122a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1abf541-3daa-4509-b401-4d9c2db076fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:34 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume e01decb7-388c-43e1-90fb-552d2b9adc59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e01decb7-388c-43e1-90fb-552d2b9adc59', 'volume_size': 1} Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:34 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Flow 'volume_create_manager' (43337094-5c0c-4675-85f9-aae06ec3ccbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a695e6-680b-4858-9a48-3f0d975607fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a695e6-680b-4858-9a48-3f0d975607fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-298323662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9349f6a6-059b-4f6e-8538-434c1c9cc5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5235b6b27a924047b3d3351ec724c3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:35Z,use_quota=True,user_id='d27574c10de94169b392018b3454ffb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277c4a85-c75b-4962-a1f5-6ae562212ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277c4a85-c75b-4962-a1f5-6ae562212ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fb00da-52bd-45ca-a3e4-ffc687c3fbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fb00da-52bd-45ca-a3e4-ffc687c3fbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9349f6a6-059b-4f6e-8538-434c1c9cc5b2', 'volume_name': 'volume-9349f6a6-059b-4f6e-8538-434c1c9cc5b2', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398601c8-8bfc-43d7-afc7-999b16da16b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398601c8-8bfc-43d7-afc7-999b16da16b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89d3428-791d-4af2-bc91-72ac985cc410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:35 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume 9349f6a6-059b-4f6e-8538-434c1c9cc5b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9349f6a6-059b-4f6e-8538-434c1c9cc5b2', 'volume_size': 1} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Flow 'volume_create_manager' (c9c962bc-6c2b-4256-a6a3-4cc9b4fafeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:35 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c136c5b3-4999-4eca-97fc-b9a22a8f34fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD" returned: 0 in 1.563s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:35 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c136c5b3-4999-4eca-97fc-b9a22a8f34fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1853939606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0551cf2c-bb71-412e-be7e-4b88121c0298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5235b6b27a924047b3d3351ec724c3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:35Z,use_quota=True,user_id='d27574c10de94169b392018b3454ffb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3445ddde-9941-4768-b877-da75abbb26ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3445ddde-9941-4768-b877-da75abbb26ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a4eae3-7751-4007-996a-c3a98b6850ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a4eae3-7751-4007-996a-c3a98b6850ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0551cf2c-bb71-412e-be7e-4b88121c0298', 'volume_name': 'volume-0551cf2c-bb71-412e-be7e-4b88121c0298', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ccf706-150e-428d-975b-633991dca33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ccf706-150e-428d-975b-633991dca33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc226706-4888-427c-88c4-07db93b2c881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:35 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume 0551cf2c-bb71-412e-be7e-4b88121c0298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0551cf2c-bb71-412e-be7e-4b88121c0298', 'volume_size': 1} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-04fd23e7-801d-40df-845c-7ab033288df9 1073741824" returned: 0 in 2.045s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:35 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD Jun 02 16:27:35 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-04fd23e7-801d-40df-845c-7ab033288df9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:36 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-04fd23e7-801d-40df-845c-7ab033288df9 Jun 02 16:27:36 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Flow 'volume_create_manager' (e1598c67-97d9-406c-8bc1-ca44949df1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8628f6a0-c5de-4a84-ab41-260a21a2b7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8628f6a0-c5de-4a84-ab41-260a21a2b7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1675428468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d44f95-889e-4797-8abe-1d7d4f990556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5235b6b27a924047b3d3351ec724c3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:36Z,use_quota=True,user_id='d27574c10de94169b392018b3454ffb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b6cf6e-900c-48d1-9b88-888e85394cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b6cf6e-900c-48d1-9b88-888e85394cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a4732c-4dee-4553-ab58-04685f2653a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a4732c-4dee-4553-ab58-04685f2653a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d44f95-889e-4797-8abe-1d7d4f990556', 'volume_name': 'volume-90d44f95-889e-4797-8abe-1d7d4f990556', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0cb038b-7749-4ff4-937a-d8f29771288b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0cb038b-7749-4ff4-937a-d8f29771288b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50814b52-b9bb-4f0d-b052-2741ab03dc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:36 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume 90d44f95-889e-4797-8abe-1d7d4f990556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d44f95-889e-4797-8abe-1d7d4f990556', 'volume_size': 1} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:36 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD" returned: 1 in 1.055s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:36 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-04fd23e7-801d-40df-845c-7ab033288df9" returned: 0 in 0.757s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] <== create_volume: return (2907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.910s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.336s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1483254707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01decb7-388c-43e1-90fb-552d2b9adc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5235b6b27a924047b3d3351ec724c3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:34Z,use_quota=True,user_id='d27574c10de94169b392018b3454ffb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Creating volume e01decb7-388c-43e1-90fb-552d2b9adc59 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:27:36 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e01decb7-388c-43e1-90fb-552d2b9adc59 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:36 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e01decb7-388c-43e1-90fb-552d2b9adc59 1073741824 Jun 02 16:27:36 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0e652b-db92-4684-bc9a-c012ef38f800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04fd23e7-801d-40df-845c-7ab033288df9', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a3f306-9fdd-4bfb-a79e-b6ff5595abc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:36 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume volume-04fd23e7-801d-40df-845c-7ab033288df9 (04fd23e7-801d-40df-845c-7ab033288df9): created successfully Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a3f306-9fdd-4bfb-a79e-b6ff5595abc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:36 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Flow 'volume_create_manager' (931e16da-e762-4353-87b7-2deb1c57aae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:36 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-320ac283-12b3-4707-98c1-3aade52c9d5d tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Created volume successfully. Jun 02 16:27:37 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e01decb7-388c-43e1-90fb-552d2b9adc59 1073741824" returned: 0 in 1.021s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e01decb7-388c-43e1-90fb-552d2b9adc59 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:37 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e01decb7-388c-43e1-90fb-552d2b9adc59 Jun 02 16:27:37 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:38 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e01decb7-388c-43e1-90fb-552d2b9adc59" returned: 0 in 0.699s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:27:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.382s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-298323662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9349f6a6-059b-4f6e-8538-434c1c9cc5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5235b6b27a924047b3d3351ec724c3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:35Z,use_quota=True,user_id='d27574c10de94169b392018b3454ffb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:27:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Creating volume 9349f6a6-059b-4f6e-8538-434c1c9cc5b2 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:27:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:27:38 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:27:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9349f6a6-059b-4f6e-8538-434c1c9cc5b2 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:38 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9349f6a6-059b-4f6e-8538-434c1c9cc5b2 1073741824 Jun 02 16:27:38 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1abf541-3daa-4509-b401-4d9c2db076fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e01decb7-388c-43e1-90fb-552d2b9adc59', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b3ab5f-97ea-4c03-a138-42f4ed19912d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:38 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume volume-e01decb7-388c-43e1-90fb-552d2b9adc59 (e01decb7-388c-43e1-90fb-552d2b9adc59): created successfully Jun 02 16:27:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b3ab5f-97ea-4c03-a138-42f4ed19912d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Flow 'volume_create_manager' (92e26798-dbe8-40dd-a071-b1e0b727fdbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:38 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-b1fe67a9-1b38-4705-9e5f-79f7e25c1bc9 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Created volume successfully. Jun 02 16:27:39 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9349f6a6-059b-4f6e-8538-434c1c9cc5b2 1073741824" returned: 0 in 0.875s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9349f6a6-059b-4f6e-8538-434c1c9cc5b2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:39 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9349f6a6-059b-4f6e-8538-434c1c9cc5b2 Jun 02 16:27:39 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:40 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9349f6a6-059b-4f6e-8538-434c1c9cc5b2" returned: 0 in 0.624s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.189s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1853939606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0551cf2c-bb71-412e-be7e-4b88121c0298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5235b6b27a924047b3d3351ec724c3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:35Z,use_quota=True,user_id='d27574c10de94169b392018b3454ffb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Creating volume 0551cf2c-bb71-412e-be7e-4b88121c0298 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:27:40 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0551cf2c-bb71-412e-be7e-4b88121c0298 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:40 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0551cf2c-bb71-412e-be7e-4b88121c0298 1073741824 Jun 02 16:27:40 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89d3428-791d-4af2-bc91-72ac985cc410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9349f6a6-059b-4f6e-8538-434c1c9cc5b2', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8063034d-db3e-4a93-9a45-0d8d6c82e1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:40 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume volume-9349f6a6-059b-4f6e-8538-434c1c9cc5b2 (9349f6a6-059b-4f6e-8538-434c1c9cc5b2): created successfully Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8063034d-db3e-4a93-9a45-0d8d6c82e1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Flow 'volume_create_manager' (43337094-5c0c-4675-85f9-aae06ec3ccbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:40 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-8c649150-73bc-45ef-b68a-9d2faa7904a6 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Created volume successfully. Jun 02 16:27:40 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0551cf2c-bb71-412e-be7e-4b88121c0298 1073741824" returned: 0 in 0.818s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0551cf2c-bb71-412e-be7e-4b88121c0298 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:40 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0551cf2c-bb71-412e-be7e-4b88121c0298 Jun 02 16:27:40 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:41 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0551cf2c-bb71-412e-be7e-4b88121c0298" returned: 0 in 0.587s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:27:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.213s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1675428468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d44f95-889e-4797-8abe-1d7d4f990556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5235b6b27a924047b3d3351ec724c3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:36Z,use_quota=True,user_id='d27574c10de94169b392018b3454ffb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:27:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Creating volume 90d44f95-889e-4797-8abe-1d7d4f990556 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:27:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:27:41 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:27:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-90d44f95-889e-4797-8abe-1d7d4f990556 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:41 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-90d44f95-889e-4797-8abe-1d7d4f990556 1073741824 Jun 02 16:27:41 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc226706-4888-427c-88c4-07db93b2c881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0551cf2c-bb71-412e-be7e-4b88121c0298', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac7d0be-0ff6-4efb-b304-d6e64f3f02c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:41 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume volume-0551cf2c-bb71-412e-be7e-4b88121c0298 (0551cf2c-bb71-412e-be7e-4b88121c0298): created successfully Jun 02 16:27:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac7d0be-0ff6-4efb-b304-d6e64f3f02c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Flow 'volume_create_manager' (c9c962bc-6c2b-4256-a6a3-4cc9b4fafeec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:41 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-6ccfb189-3ac0-4f44-b370-de658ddbfb10 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Created volume successfully. Jun 02 16:27:42 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-90d44f95-889e-4797-8abe-1d7d4f990556 1073741824" returned: 0 in 0.807s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-90d44f95-889e-4797-8abe-1d7d4f990556 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:42 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-90d44f95-889e-4797-8abe-1d7d4f990556 Jun 02 16:27:42 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:43 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-90d44f95-889e-4797-8abe-1d7d4f990556" returned: 0 in 0.651s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.291s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198c4bc5-105f-4b44-8bf8-a7d7772b887b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='242ef46ecb8b45dfadafd7709fa3853d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:27:32Z,use_quota=True,user_id='4da4c97e1790426d94c83ec419bf3564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Creating volume 198c4bc5-105f-4b44-8bf8-a7d7772b887b {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:27:43 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50814b52-b9bb-4f0d-b052-2741ab03dc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d44f95-889e-4797-8abe-1d7d4f990556', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1769d7ea-aef2-4e0c-8f76-46818f091f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:43 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b 1073741824 Jun 02 16:27:43 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:43 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Volume volume-90d44f95-889e-4797-8abe-1d7d4f990556 (90d44f95-889e-4797-8abe-1d7d4f990556): created successfully Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1769d7ea-aef2-4e0c-8f76-46818f091f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Flow 'volume_create_manager' (e1598c67-97d9-406c-8bc1-ca44949df1c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:43 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-287431d0-b1dc-4016-b5cd-569bb95e21bb tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Created volume successfully. Jun 02 16:27:43 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b 1073741824" returned: 0 in 0.792s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:43 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b Jun 02 16:27:43 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:43 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "cinder-90d44f95-889e-4797-8abe-1d7d4f990556-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:44 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-90d44f95-889e-4797-8abe-1d7d4f990556-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:44 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "cinder-quobyte-90d44f95-889e-4797-8abe-1d7d4f990556" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:44 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-quobyte-90d44f95-889e-4797-8abe-1d7d4f990556" acquired by "delete_volume" :: waited 0.029s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:44 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[76006e2c-e3a4-438c-ab19-f1c63f4430c6]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-90d44f95-889e-4797-8abe-1d7d4f990556 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:44 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-90d44f95-889e-4797-8abe-1d7d4f990556 Jun 02 16:27:44 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:44 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b" returned: 0 in 0.653s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:27:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:44 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Attempting download of 3928a120-f2df-44ce-85c4-60fa5423f446 ((None, [{'url': 'file:///opt/stack/data/glance/images/3928a120-f2df-44ce-85c4-60fa5423f446', 'metadata': {}}])) to volume 198c4bc5-105f-4b44-8bf8-a7d7772b887b. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 16:27:44 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e764e2b9-f20c-443a-a581-ae1bb8cc4c1a]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3928a120-f2df-44ce-85c4-60fa5423f446_desrx76_ {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:44 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3928a120-f2df-44ce-85c4-60fa5423f446_desrx76_ Jun 02 16:27:44 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:44 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-90d44f95-889e-4797-8abe-1d7d4f990556" returned: 0 in 0.783s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-90d44f95-889e-4797-8abe-1d7d4f990556 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:44 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-90d44f95-889e-4797-8abe-1d7d4f990556 Jun 02 16:27:44 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:45 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3928a120-f2df-44ce-85c4-60fa5423f446_desrx76_" returned: 0 in 0.742s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3928a120-f2df-44ce-85c4-60fa5423f446_desrx76_ {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:45 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3928a120-f2df-44ce-85c4-60fa5423f446_desrx76_ Jun 02 16:27:45 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:45 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-90d44f95-889e-4797-8abe-1d7d4f990556" returned: 0 in 0.663s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:45 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-quobyte-90d44f95-889e-4797-8abe-1d7d4f990556" released by "delete_volume" :: held 1.497s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:45 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Created reservations ['33ea343d-7562-42ba-a862-5d220e679bd8', 'a7f5b627-a0bf-4380-b79d-06f89c9c9a47', '84c60951-c38d-4c21-ac30-007b222934c6', '3e6e4093-5955-4a5b-9673-3bb3724ec5cb'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:45 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:45 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:45 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:46 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3928a120-f2df-44ce-85c4-60fa5423f446_desrx76_" returned: 1 in 0.796s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3928a120-f2df-44ce-85c4-60fa5423f446_desrx76_' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:27:46 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5437e4-0359-451c-9ecd-9802ca296653]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "cinder-0551cf2c-bb71-412e-be7e-4b88121c0298-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-0551cf2c-bb71-412e-be7e-4b88121c0298-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:46 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD Jun 02 16:27:46 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "cinder-quobyte-0551cf2c-bb71-412e-be7e-4b88121c0298" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-quobyte-0551cf2c-bb71-412e-be7e-4b88121c0298" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:46 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c19d31-fb16-4649-95ab-3144eb483a81]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0551cf2c-bb71-412e-be7e-4b88121c0298 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:46 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.782s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:46 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:46 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Deleted volume successfully. Jun 02 16:27:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1f24260b-3dde-450c-bbca-1ac7ed11f981 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-90d44f95-889e-4797-8abe-1d7d4f990556-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:46 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0551cf2c-bb71-412e-be7e-4b88121c0298 Jun 02 16:27:46 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:46 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:47 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD Jun 02 16:27:47 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:47 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0551cf2c-bb71-412e-be7e-4b88121c0298" returned: 0 in 0.779s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0551cf2c-bb71-412e-be7e-4b88121c0298 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:47 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0551cf2c-bb71-412e-be7e-4b88121c0298 Jun 02 16:27:47 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:47 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD" returned: 1 in 0.791s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:27:47 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] 3928a120-f2df-44ce-85c4-60fa5423f446 was raw, converting to raw {{(pid=86488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 16:27:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:47 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b Jun 02 16:27:47 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:47 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-0551cf2c-bb71-412e-be7e-4b88121c0298" returned: 0 in 0.642s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:47 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-quobyte-0551cf2c-bb71-412e-be7e-4b88121c0298" released by "delete_volume" :: held 1.501s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:47 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Created reservations ['81e2142e-c5ce-42f4-8414-091df70fc09a', '3880a864-2542-4530-9ef0-aa4845355a73', '05502422-7903-480c-b176-5cf4e3c4a9e6', 'f09d8960-1b09-4a83-af0d-6305433b9a06'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:48 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:48 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:48 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b" returned: 0 in 0.771s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3928a120-f2df-44ce-85c4-60fa5423f446_1plz6aybdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:27:48 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Converted 0.00 MB image at 0.00 MB/s Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:48 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b 1G Jun 02 16:27:48 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "cinder-9349f6a6-059b-4f6e-8538-434c1c9cc5b2-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-9349f6a6-059b-4f6e-8538-434c1c9cc5b2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "cinder-quobyte-9349f6a6-059b-4f6e-8538-434c1c9cc5b2" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-quobyte-9349f6a6-059b-4f6e-8538-434c1c9cc5b2" acquired by "delete_volume" :: waited 0.017s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[176578f1-9fba-481b-929c-01b0271d5d06]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9349f6a6-059b-4f6e-8538-434c1c9cc5b2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:48 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.699s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:48 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Deleted volume successfully. Jun 02 16:27:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-860ed590-eb6b-4967-ad73-47328ae81b85 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-0551cf2c-bb71-412e-be7e-4b88121c0298-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:48 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9349f6a6-059b-4f6e-8538-434c1c9cc5b2 Jun 02 16:27:48 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:49 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b 1G" returned: 0 in 0.674s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:49 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8220845-4d61-4668-842d-26992b7ce5bc]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:49 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b Jun 02 16:27:49 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:49 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9349f6a6-059b-4f6e-8538-434c1c9cc5b2" returned: 0 in 0.757s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9349f6a6-059b-4f6e-8538-434c1c9cc5b2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:49 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9349f6a6-059b-4f6e-8538-434c1c9cc5b2 Jun 02 16:27:49 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:50 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b" returned: 0 in 0.728s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:50 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-9349f6a6-059b-4f6e-8538-434c1c9cc5b2" returned: 0 in 0.629s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-quobyte-9349f6a6-059b-4f6e-8538-434c1c9cc5b2" released by "delete_volume" :: held 1.437s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:50 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b Jun 02 16:27:50 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Created reservations ['db641621-6f0e-4247-9386-ba96b6055056', '85429dcf-5ac2-4426-9087-5bfd99bfcfbb', 'cf9a5d4a-a226-41d7-b7ef-e341d42ac426', '67e78288-6ae4-445c-8514-f416d357952c'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:50 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:50 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:50 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b" returned: 1 in 0.726s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Downloaded image 3928a120-f2df-44ce-85c4-60fa5423f446 ((None, [{'url': 'file:///opt/stack/data/glance/images/3928a120-f2df-44ce-85c4-60fa5423f446', 'metadata': {}}])) to volume 198c4bc5-105f-4b44-8bf8-a7d7772b887b successfully. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Temporary image 3928a120-f2df-44ce-85c4-60fa5423f446 for user 4da4c97e1790426d94c83ec419bf3564 is deleted. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Marking volume 198c4bc5-105f-4b44-8bf8-a7d7772b887b as bootable. {{(pid=86488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Copying metadata from image 3928a120-f2df-44ce-85c4-60fa5423f446 to 198c4bc5-105f-4b44-8bf8-a7d7772b887b. {{(pid=86488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Creating volume glance metadata for volume 198c4bc5-105f-4b44-8bf8-a7d7772b887b backed by image 3928a120-f2df-44ce-85c4-60fa5423f446 with: {'image_id': '3928a120-f2df-44ce-85c4-60fa5423f446', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '16135206ce5123f4511171f76ff59304', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da21b8c6-8192-453c-9e12-fd2d3bd2541f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b', 'volume_size': 1, 'image_id': '3928a120-f2df-44ce-85c4-60fa5423f446', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3928a120-f2df-44ce-85c4-60fa5423f446', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16135206ce5123f4511171f76ff59304', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '242ef46ecb8b45dfadafd7709fa3853d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5631429c75a60e604e12a37521ccd57ade7960ded14c59e8e84bca71bcdbaa1089069eefb188e6270cf21665d43c6f14ec5825e89776ccabdab5a4f8ea52dd70', 'id': '3928a120-f2df-44ce-85c4-60fa5423f446', 'created_at': datetime.datetime(2026, 6, 2, 14, 27, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 27, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3928a120-f2df-44ce-85c4-60fa5423f446/file', 'properties': {}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3777b88f-ec66-4636-8a23-ca93ab00ab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:50 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.620s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:50 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Volume volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b (198c4bc5-105f-4b44-8bf8-a7d7772b887b): created successfully Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3777b88f-ec66-4636-8a23-ca93ab00ab59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Flow 'volume_create_manager' (cceae020-d7b4-4169-8433-89b49067344d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "cinder-e01decb7-388c-43e1-90fb-552d2b9adc59-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:50 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Deleted volume successfully. Jun 02 16:27:50 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-98305e88-15e4-4bf7-8a10-58084d3e4100 tempest-VolumeImageDependencyTests-1728870837 None] Created volume successfully. Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-e01decb7-388c-43e1-90fb-552d2b9adc59-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-6562e7f6-c9a7-4dbb-bcfd-87cf2cbc7e97 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-9349f6a6-059b-4f6e-8538-434c1c9cc5b2-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "cinder-quobyte-e01decb7-388c-43e1-90fb-552d2b9adc59" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-quobyte-e01decb7-388c-43e1-90fb-552d2b9adc59" acquired by "delete_volume" :: waited 0.012s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9544cf-39c7-43a8-ba9f-4be5b91501f3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e01decb7-388c-43e1-90fb-552d2b9adc59 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:51 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e01decb7-388c-43e1-90fb-552d2b9adc59 Jun 02 16:27:51 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:51 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Acquiring lock "cinder-198c4bc5-105f-4b44-8bf8-a7d7772b887b-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:51 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Lock "cinder-198c4bc5-105f-4b44-8bf8-a7d7772b887b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:51 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Acquiring lock "cinder-quobyte-198c4bc5-105f-4b44-8bf8-a7d7772b887b" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:51 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Lock "cinder-quobyte-198c4bc5-105f-4b44-8bf8-a7d7772b887b" acquired by "delete_volume" :: waited 0.021s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:51 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9afe24-e24b-43a7-841d-1c32455d503b]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:51 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e01decb7-388c-43e1-90fb-552d2b9adc59" returned: 0 in 0.764s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e01decb7-388c-43e1-90fb-552d2b9adc59 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:51 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b Jun 02 16:27:51 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:51 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e01decb7-388c-43e1-90fb-552d2b9adc59 Jun 02 16:27:51 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:52 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b" returned: 0 in 0.714s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:52 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e01decb7-388c-43e1-90fb-552d2b9adc59" returned: 0 in 0.628s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:52 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-quobyte-e01decb7-388c-43e1-90fb-552d2b9adc59" released by "delete_volume" :: held 1.430s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:52 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Created reservations ['bdf4f0e0-55c6-4e96-a7ad-11ca2a2ff048', '9244e1a2-65f8-40b0-b169-ee46b5a0122b', '699fa368-e6e7-4fce-9b11-304fea88ec37', '392d1c74-c88a-4f14-92fd-f9ef8cc2de0d'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:52 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b Jun 02 16:27:52 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:52 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:52 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:52 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:52 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:53 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:53 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "cinder-04fd23e7-801d-40df-845c-7ab033288df9-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b" returned: 1 in 0.762s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.632s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:53 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Deleted volume successfully. Jun 02 16:27:53 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b Jun 02 16:27:53 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-04fd23e7-801d-40df-845c-7ab033288df9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c25489e6-e19b-4034-9f2d-4f6a40356e07 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-e01decb7-388c-43e1-90fb-552d2b9adc59-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "cinder-quobyte-04fd23e7-801d-40df-845c-7ab033288df9" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-quobyte-04fd23e7-801d-40df-845c-7ab033288df9" acquired by "delete_volume" :: waited 0.015s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[99115b1c-e0ac-41e0-8671-49e9229cfd3f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-04fd23e7-801d-40df-845c-7ab033288df9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:53 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-04fd23e7-801d-40df-845c-7ab033288df9 Jun 02 16:27:53 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:53 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-198c4bc5-105f-4b44-8bf8-a7d7772b887b" returned: 0 in 0.640s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Lock "cinder-quobyte-198c4bc5-105f-4b44-8bf8-a7d7772b887b" released by "delete_volume" :: held 2.187s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Created reservations ['16ac56c7-05e2-4bdf-8656-433e066f9aa1', '3afbf081-24e1-486c-b298-3031517bcb0d', 'd32a48ed-0a7a-4c72-99a9-976fa55b462c', 'dcc029cd-826b-480a-a8ab-20c80a0689c2'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:53 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:53 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:53 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-04fd23e7-801d-40df-845c-7ab033288df9" returned: 0 in 0.728s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-04fd23e7-801d-40df-845c-7ab033288df9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:54 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-04fd23e7-801d-40df-845c-7ab033288df9 Jun 02 16:27:54 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:54 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.618s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:54 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:54 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Deleted volume successfully. Jun 02 16:27:54 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a0458d76-7e97-4a89-9a0f-4738eef3e5b5 tempest-VolumeImageDependencyTests-1728870837 None] Lock "cinder-198c4bc5-105f-4b44-8bf8-a7d7772b887b-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:54 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-04fd23e7-801d-40df-845c-7ab033288df9" returned: 0 in 0.658s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:54 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-quobyte-04fd23e7-801d-40df-845c-7ab033288df9" released by "delete_volume" :: held 1.435s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:54 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Created reservations ['75072072-150e-42bd-8ea0-05e30e6da1e6', 'f79ecf1d-ea5b-4858-94fa-2539bcc5aa7c', '8b7f4ae5-b883-4373-90da-1e897cde66dd', '932b67ff-f50f-4882-a190-1ca61dd91b1b'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:54 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:54 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:54 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:54 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:55 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "cinder-c00532cd-d97a-4238-8078-02e1477ae921-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:55 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-c00532cd-d97a-4238-8078-02e1477ae921-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:55 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "cinder-quobyte-c00532cd-d97a-4238-8078-02e1477ae921" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:27:55 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-quobyte-c00532cd-d97a-4238-8078-02e1477ae921" acquired by "delete_volume" :: waited 0.024s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:27:55 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95b02ec-580b-475e-af0d-45f39bc2f80b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:27:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c00532cd-d97a-4238-8078-02e1477ae921 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:55 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.800s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:55 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:55 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Deleted volume successfully. Jun 02 16:27:55 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ad2b4bcd-c155-497a-878f-23620eeba23f tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-04fd23e7-801d-40df-845c-7ab033288df9-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:55 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c00532cd-d97a-4238-8078-02e1477ae921 Jun 02 16:27:55 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:56 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c00532cd-d97a-4238-8078-02e1477ae921" returned: 0 in 0.830s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c00532cd-d97a-4238-8078-02e1477ae921 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:56 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c00532cd-d97a-4238-8078-02e1477ae921 Jun 02 16:27:56 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:57 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-c00532cd-d97a-4238-8078-02e1477ae921" returned: 0 in 0.708s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:57 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-quobyte-c00532cd-d97a-4238-8078-02e1477ae921" released by "delete_volume" :: held 1.612s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:57 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Created reservations ['97ba6f01-df91-44a3-a976-ab736faf3ebc', '5f45fe26-9656-40d3-8a6c-72d381dc2941', '54c5e327-cb1a-42cc-af9a-fa5458900d8c', '8d787a52-4ae1-477c-91f6-74afff159d51'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:27:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:57 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:57 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:27:57 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:27:57 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jun 02 16:27:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.647s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:27:57 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:27:57 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Deleted volume successfully. Jun 02 16:27:57 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-4e620710-1fb0-45ba-b15f-60332261a174 tempest-CreateVolumesFromSourceVolumeTest-551536451 None] Lock "cinder-c00532cd-d97a-4238-8078-02e1477ae921-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Flow 'volume_create_manager' (ad57beb4-2654-45d7-879b-06206a8b32c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87323b2c-657c-4e30-8c41-5a19b579482f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87323b2c-657c-4e30-8c41-5a19b579482f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1846225358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90cf019-4aef-4460-829f-c46aea1d12ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1833fc58ba4414faea20bc7a8b7700a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:28:00Z,use_quota=True,user_id='7821818aaef14f6d84a5ee9e88c372fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5068a7c-06ba-4685-a5f0-3a2df474cdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5068a7c-06ba-4685-a5f0-3a2df474cdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7378d7d4-6034-4766-9391-c79dc0729ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7378d7d4-6034-4766-9391-c79dc0729ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b90cf019-4aef-4460-829f-c46aea1d12ef', 'volume_name': 'volume-b90cf019-4aef-4460-829f-c46aea1d12ef', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d7afc7-7afc-4b70-b539-ae6710c71b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d7afc7-7afc-4b70-b539-ae6710c71b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d89c517-15c6-4931-ae49-b1d3cc476eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:27:59 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Volume b90cf019-4aef-4460-829f-c46aea1d12ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b90cf019-4aef-4460-829f-c46aea1d12ef', 'volume_size': 1} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1846225358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90cf019-4aef-4460-829f-c46aea1d12ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1833fc58ba4414faea20bc7a8b7700a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:28:00Z,use_quota=True,user_id='7821818aaef14f6d84a5ee9e88c372fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Creating volume b90cf019-4aef-4460-829f-c46aea1d12ef {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:27:59 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:27:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b90cf019-4aef-4460-829f-c46aea1d12ef 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:27:59 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b90cf019-4aef-4460-829f-c46aea1d12ef 1073741824 Jun 02 16:27:59 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:00 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:28:00 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Flow 'volume_create_manager' (0081f82b-6b64-4aa4-8203-cbd6e23e6f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794f2dcf-39e1-4d37-8116-7815e3a0d9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794f2dcf-39e1-4d37-8116-7815e3a0d9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1451111260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3469d16-736d-47d0-b95e-0bf65fcbdd5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b288f7dc3b4e64b09a8bb33973e3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:28:00Z,use_quota=True,user_id='d2d73080485c42ae97e50cda4ef03e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86239333-1aae-46ae-8187-cbb13d635595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86239333-1aae-46ae-8187-cbb13d635595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b724cf-e488-4b03-bed0-0257d5a99af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b724cf-e488-4b03-bed0-0257d5a99af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3469d16-736d-47d0-b95e-0bf65fcbdd5d', 'volume_name': 'volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07672c5-9d84-411f-896b-28b340143372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07672c5-9d84-411f-896b-28b340143372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5d4b12-6b74-4245-ac01-3b0601768ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:00 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Volume a3469d16-736d-47d0-b95e-0bf65fcbdd5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d', 'volume_size': 1} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:28:00 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b90cf019-4aef-4460-829f-c46aea1d12ef 1073741824" returned: 0 in 0.875s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b90cf019-4aef-4460-829f-c46aea1d12ef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:00 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.665s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:00 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:28:00 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b90cf019-4aef-4460-829f-c46aea1d12ef Jun 02 16:28:00 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:01 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b90cf019-4aef-4460-829f-c46aea1d12ef" returned: 0 in 0.598s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:28:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:28:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.762s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:28:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1451111260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3469d16-736d-47d0-b95e-0bf65fcbdd5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b288f7dc3b4e64b09a8bb33973e3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:28:00Z,use_quota=True,user_id='d2d73080485c42ae97e50cda4ef03e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:28:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Creating volume a3469d16-736d-47d0-b95e-0bf65fcbdd5d {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:28:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:28:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:28:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:28:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:28:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:28:01 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:28:01 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:28:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d89c517-15c6-4931-ae49-b1d3cc476eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b90cf019-4aef-4460-829f-c46aea1d12ef', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f493954e-7ef2-4f5c-8bdd-45cece984ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:01 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d 1073741824 Jun 02 16:28:01 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:01 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Volume volume-b90cf019-4aef-4460-829f-c46aea1d12ef (b90cf019-4aef-4460-829f-c46aea1d12ef): created successfully Jun 02 16:28:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f493954e-7ef2-4f5c-8bdd-45cece984ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Flow 'volume_create_manager' (ad57beb4-2654-45d7-879b-06206a8b32c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:28:01 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-a9ebb739-fe78-4170-abb1-cccd8b423eb4 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Created volume successfully. Jun 02 16:28:02 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d 1073741824" returned: 0 in 0.810s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:02 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d Jun 02 16:28:02 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:02 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d" returned: 0 in 0.607s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:28:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:28:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5d4b12-6b74-4245-ac01-3b0601768ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c478fc7b-7ce9-49d1-98dd-0aa03f96ad0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:02 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Volume volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d (a3469d16-736d-47d0-b95e-0bf65fcbdd5d): created successfully Jun 02 16:28:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c478fc7b-7ce9-49d1-98dd-0aa03f96ad0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Flow 'volume_create_manager' (0081f82b-6b64-4aa4-8203-cbd6e23e6f94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:28:02 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-59ce76af-f16b-4b83-a535-08d3ec60a91d tempest-VolumeDependencyTests-878234146 None] Created volume successfully. Jun 02 16:28:03 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=124,cinder:INSERT=53,cinder:UPDATE=210,cinder:DELETE=18 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:28:03 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:UPDATE=186,cinder:DELETE=16,cinder:SELECT=138,cinder:INSERT=48 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:28:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:28:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:28:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] Creating offline snapshot 25c846cb-60c8-4680-85ff-365f129594a0 of volume a3469d16-736d-47d0-b95e-0bf65fcbdd5d {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:28:03 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4448d9-86af-4536-b33e-ec83d2fc55a6]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:28:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:03 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d Jun 02 16:28:03 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:04 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d" returned: 0 in 0.722s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:04 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0 1G Jun 02 16:28:04 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-316ef1f8-6f71-4e31-a0c9-28c8671e6c4e req-dfc01a64-3651-4b4c-98cb-ad6c6d185ce8 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:28:05 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0 1G" returned: 0 in 0.792s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:05 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0 Jun 02 16:28:05 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:06 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0" returned: 0 in 0.635s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:06 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0 is being set with open permissions: ugo+rw Jun 02 16:28:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:06 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0 Jun 02 16:28:06 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:06 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0" returned: 0 in 0.579s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:06 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.info Jun 02 16:28:06 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:07 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.info" returned: 0 in 0.633s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:07 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.info is being set with open permissions: ugo+rw Jun 02 16:28:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:07 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.info Jun 02 16:28:07 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:07 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.info" returned: 0 in 0.575s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.024s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:28:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-316ef1f8-6f71-4e31-a0c9-28c8671e6c4e req-dfc01a64-3651-4b4c-98cb-ad6c6d185ce8 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.758s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:28:07 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb015b8-8c06-46cd-9b74-11bb5385cea4]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:28:07 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-20c6e8e5-7a28-49f9-9d96-07cc9d0e1854 tempest-VolumeDependencyTests-878234146 None] Create snapshot completed successfully Jun 02 16:28:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-316ef1f8-6f71-4e31-a0c9-28c8671e6c4e req-dfc01a64-3651-4b4c-98cb-ad6c6d185ce8 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b90cf019-4aef-4460-829f-c46aea1d12ef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:08 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b90cf019-4aef-4460-829f-c46aea1d12ef Jun 02 16:28:08 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Flow 'volume_create_manager' (6f10eae9-e63b-4c95-bf0e-ee771890bf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbf76cc-5b46-49ec-a9db-8a4fc3befc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbf76cc-5b46-49ec-a9db-8a4fc3befc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-94580030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449105a2-85cf-4725-b4ce-e4438d39ef3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b288f7dc3b4e64b09a8bb33973e3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=25c846cb-60c8-4680-85ff-365f129594a0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:28:08Z,use_quota=True,user_id='d2d73080485c42ae97e50cda4ef03e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb0254d-8744-4f64-8a0d-e4c65801a3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb0254d-8744-4f64-8a0d-e4c65801a3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524ea4fc-8b2f-4480-a97c-035e9a0d03f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524ea4fc-8b2f-4480-a97c-035e9a0d03f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '449105a2-85cf-4725-b4ce-e4438d39ef3b', 'volume_name': 'volume-449105a2-85cf-4725-b4ce-e4438d39ef3b', 'volume_size': 1, 'snapshot_id': '25c846cb-60c8-4680-85ff-365f129594a0'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a8763a-093e-4291-ae04-49b13fe6ba51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a8763a-093e-4291-ae04-49b13fe6ba51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5639d3b3-8aa3-49b9-b87a-b860496d521c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:08 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Volume 449105a2-85cf-4725-b4ce-e4438d39ef3b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-449105a2-85cf-4725-b4ce-e4438d39ef3b', 'volume_size': 1, 'snapshot_id': '25c846cb-60c8-4680-85ff-365f129594a0'} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:28:08 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [req-316ef1f8-6f71-4e31-a0c9-28c8671e6c4e req-dfc01a64-3651-4b4c-98cb-ad6c6d185ce8 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b90cf019-4aef-4460-829f-c46aea1d12ef" returned: 0 in 0.708s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [req-316ef1f8-6f71-4e31-a0c9-28c8671e6c4e req-dfc01a64-3651-4b4c-98cb-ad6c6d185ce8 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.735s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Acquiring lock "cinder-quobyte-25c846cb-60c8-4680-85ff-365f129594a0-449105a2-85cf-4725-b4ce-e4438d39ef3b" by "_create_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Lock "cinder-quobyte-25c846cb-60c8-4680-85ff-365f129594a0-449105a2-85cf-4725-b4ce-e4438d39ef3b" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Creating volume 449105a2-85cf-4725-b4ce-e4438d39ef3b from snapshot 25c846cb-60c8-4680-85ff-365f129594a0 {{(pid=86488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Acquiring lock "cinder-quobyte-449105a2-85cf-4725-b4ce-e4438d39ef3b" by "_copy_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Lock "cinder-quobyte-449105a2-85cf-4725-b4ce-e4438d39ef3b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] snapshot: 25c846cb-60c8-4680-85ff-365f129594a0, volume: 449105a2-85cf-4725-b4ce-e4438d39ef3b, {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-316ef1f8-6f71-4e31-a0c9-28c8671e6c4e req-dfc01a64-3651-4b4c-98cb-ad6c6d185ce8 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757', 'name': 'volume-b90cf019-4aef-4460-829f-c46aea1d12ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2035bb0e-7d49-4f51-9b30-4e7191acf4c0', 'enforce_multipath': True} {{(pid=86488) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[487cc7f6-4424-47ec-bbfb-934451a2378f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:28:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:08 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-316ef1f8-6f71-4e31-a0c9-28c8671e6c4e req-dfc01a64-3651-4b4c-98cb-ad6c6d185ce8 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] attachment_update completed successfully. Jun 02 16:28:08 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0 Jun 02 16:28:08 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:09 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0" returned: 0 in 0.762s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:28:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 16:28:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Creating direct copy from snapshot {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 16:28:09 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ad5b36-5b05-4398-b1f9-27e21b5beaa0]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:28:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:09 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d Jun 02 16:28:09 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:10 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d" returned: 0 in 0.746s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:10 devstack cinder-volume[86488]: DEBUG cinder.utils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Path /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-449105a2-85cf-4725-b4ce-e4438d39ef3b not found in is_blk_device check {{(pid=86488) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 16:28:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-449105a2-85cf-4725-b4ce-e4438d39ef3b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:10 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-449105a2-85cf-4725-b4ce-e4438d39ef3b Jun 02 16:28:10 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:15 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-449105a2-85cf-4725-b4ce-e4438d39ef3b" returned: 0 in 4.775s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:15 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fe177d-0b00-4857-996e-206ac966d509]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:28:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:15 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d Jun 02 16:28:15 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:15 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d" returned: 0 in 0.887s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:15 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Image conversion details: src /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d, size 1024.00 MB, duration 4.78 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-449105a2-85cf-4725-b4ce-e4438d39ef3b {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:28:15 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Converted 1024.00 MB image at 214.39 MB/s Jun 02 16:28:15 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-449105a2-85cf-4725-b4ce-e4438d39ef3b is being set with open permissions: ugo+rw Jun 02 16:28:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-449105a2-85cf-4725-b4ce-e4438d39ef3b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:15 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-449105a2-85cf-4725-b4ce-e4438d39ef3b Jun 02 16:28:15 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:16 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-449105a2-85cf-4725-b4ce-e4438d39ef3b" returned: 0 in 0.605s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Lock "cinder-quobyte-449105a2-85cf-4725-b4ce-e4438d39ef3b" released by "_copy_volume_from_snapshot" :: held 7.879s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:28:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Lock "cinder-quobyte-25c846cb-60c8-4680-85ff-365f129594a0-449105a2-85cf-4725-b4ce-e4438d39ef3b" released by "_create_volume_from_snapshot" :: held 7.911s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:28:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.926s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:28:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5639d3b3-8aa3-49b9-b87a-b860496d521c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-449105a2-85cf-4725-b4ce-e4438d39ef3b', 'volume_size': 1, 'snapshot_id': '25c846cb-60c8-4680-85ff-365f129594a0'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b398c51-17db-463a-b081-7dbaa9880ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:16 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Volume volume-449105a2-85cf-4725-b4ce-e4438d39ef3b (449105a2-85cf-4725-b4ce-e4438d39ef3b): created successfully Jun 02 16:28:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b398c51-17db-463a-b081-7dbaa9880ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Flow 'volume_create_manager' (6f10eae9-e63b-4c95-bf0e-ee771890bf40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:28:16 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-2f445a05-0628-4829-9018-e2fabd91c369 tempest-VolumeDependencyTests-878234146 None] Created volume successfully. Jun 02 16:28:16 devstack cinder-volume[86488]: INFO cinder.volume.manager [req-65e03ffc-8369-4ec6-b5e5-5da3f64429cc req-891b6024-b389-4fbc-9990-24761b0704b3 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Terminate volume connection completed successfully. Jun 02 16:28:16 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [req-65e03ffc-8369-4ec6-b5e5-5da3f64429cc req-891b6024-b389-4fbc-9990-24761b0704b3 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Deleting attachment 2035bb0e-7d49-4f51-9b30-4e7191acf4c0. {{(pid=86488) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 16:28:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] Acquiring lock "cinder-25c846cb-60c8-4680-85ff-365f129594a0-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:28:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] Lock "cinder-25c846cb-60c8-4680-85ff-365f129594a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:28:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] Acquiring lock "cinder-quobyte-a3469d16-736d-47d0-b95e-0bf65fcbdd5d" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:28:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] Lock "cinder-quobyte-a3469d16-736d-47d0-b95e-0bf65fcbdd5d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:28:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] Acquiring lock "cinder-quobyte-25c846cb-60c8-4680-85ff-365f129594a0" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:28:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] Lock "cinder-quobyte-25c846cb-60c8-4680-85ff-365f129594a0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:28:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] Deleting offline snapshot 25c846cb-60c8-4680-85ff-365f129594a0 of volume a3469d16-736d-47d0-b95e-0bf65fcbdd5d {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:28:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] snapshot_file for this snap is: volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:28:17 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ff4bb8-217d-43cf-ae67-5d08be6d51ba]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:28:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:17 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0 Jun 02 16:28:17 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:18 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0" returned: 0 in 0.722s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:28:18 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[987053f1-d5a0-4e9d-8bea-57a08810ab05]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:28:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:18 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d Jun 02 16:28:18 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Acquiring lock "cinder-b90cf019-4aef-4460-829f-c46aea1d12ef-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:28:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Lock "cinder-b90cf019-4aef-4460-829f-c46aea1d12ef-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:28:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Acquiring lock "cinder-quobyte-b90cf019-4aef-4460-829f-c46aea1d12ef" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:28:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Lock "cinder-quobyte-b90cf019-4aef-4460-829f-c46aea1d12ef" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:28:18 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[41599471-abc9-4a74-a80a-a8290cc09a68]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:28:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b90cf019-4aef-4460-829f-c46aea1d12ef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:19 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b90cf019-4aef-4460-829f-c46aea1d12ef Jun 02 16:28:19 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:19 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d" returned: 0 in 0.777s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:19 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0 Jun 02 16:28:19 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:19 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b90cf019-4aef-4460-829f-c46aea1d12ef" returned: 0 in 0.767s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b90cf019-4aef-4460-829f-c46aea1d12ef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:19 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b90cf019-4aef-4460-829f-c46aea1d12ef Jun 02 16:28:19 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:20 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0" returned: 0 in 0.751s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:20 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0 Jun 02 16:28:20 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:20 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b90cf019-4aef-4460-829f-c46aea1d12ef" returned: 0 in 0.644s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Lock "cinder-quobyte-b90cf019-4aef-4460-829f-c46aea1d12ef" released by "delete_volume" :: held 1.458s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Created reservations ['7ccab668-c8ec-4e15-9c3a-53aa5c51854d', 'd49ab527-1784-4641-b517-658585e19db9', '58bc26c2-414e-4915-814a-e948c4b42776', '70796b16-4ee8-4fea-a348-01cbddf511dc'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:20 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:28:20 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:20 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d.25c846cb-60c8-4680-85ff-365f129594a0" returned: 0 in 0.597s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] Lock "cinder-quobyte-25c846cb-60c8-4680-85ff-365f129594a0" released by "_delete_snapshot" :: held 2.958s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] Lock "cinder-quobyte-a3469d16-736d-47d0-b95e-0bf65fcbdd5d" released by "delete_snapshot" :: held 2.989s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] Created reservations ['ea4a9c9b-d0d1-4a08-8c84-f165eb3c7f16', '71775035-2599-4fe8-9b04-9024bc960ca6', 'a7d7e6a7-27db-4161-ac11-b395e6ef2840', 'cef1ab67-b667-4c7c-92b3-8f521f20362b'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:28:20 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] Delete snapshot completed successfully. Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-d6f4b27e-b1cb-49b1-a1f3-d0a0835fccaa tempest-VolumeDependencyTests-878234146 None] Lock "cinder-25c846cb-60c8-4680-85ff-365f129594a0-delete_snapshot" released by "delete_snapshot" :: held 3.147s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] Acquiring lock "cinder-a3469d16-736d-47d0-b95e-0bf65fcbdd5d-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] Lock "cinder-a3469d16-736d-47d0-b95e-0bf65fcbdd5d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] Acquiring lock "cinder-quobyte-a3469d16-736d-47d0-b95e-0bf65fcbdd5d" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:28:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] Lock "cinder-quobyte-a3469d16-736d-47d0-b95e-0bf65fcbdd5d" acquired by "delete_volume" :: waited 0.017s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:28:21 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e9f9e4-4897-435a-bab0-78b4c40845ec]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:28:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:21 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d Jun 02 16:28:21 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:21 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.666s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:21 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:28:21 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Deleted volume successfully. Jun 02 16:28:21 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-bb8ef92b-eefd-46f1-8d6f-70aab4c4b5e7 tempest-TestServerVolumeAttachScenarioOldVersion-1897301973 None] Lock "cinder-b90cf019-4aef-4460-829f-c46aea1d12ef-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:28:21 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d" returned: 0 in 0.741s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:21 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d Jun 02 16:28:21 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:22 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a3469d16-736d-47d0-b95e-0bf65fcbdd5d" returned: 0 in 0.728s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] Lock "cinder-quobyte-a3469d16-736d-47d0-b95e-0bf65fcbdd5d" released by "delete_volume" :: held 1.536s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:28:22 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] Created reservations ['e1c13c9e-2584-473b-803f-5a3d9f2e84fc', 'fdfd08a4-7a46-4f0c-993e-9b6858b9e3dc', '0bb79fab-d84a-4102-95cf-d5aef1c85e11', '22c7eb76-80a7-4a63-8d36-a85050102fd6'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:28:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:28:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:28:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:28:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:28:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:28:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:22 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:28:22 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] Acquiring lock "cinder-449105a2-85cf-4725-b4ce-e4438d39ef3b-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:28:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] Lock "cinder-449105a2-85cf-4725-b4ce-e4438d39ef3b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:28:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] Acquiring lock "cinder-quobyte-449105a2-85cf-4725-b4ce-e4438d39ef3b" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:28:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] Lock "cinder-quobyte-449105a2-85cf-4725-b4ce-e4438d39ef3b" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:28:23 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f103f2-7599-4b52-98db-f0c78f0c344f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:28:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-449105a2-85cf-4725-b4ce-e4438d39ef3b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:23 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.630s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:23 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:28:23 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] Deleted volume successfully. Jun 02 16:28:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-57569221-0e2f-4ca8-9eed-eda33799030b tempest-VolumeDependencyTests-878234146 None] Lock "cinder-a3469d16-736d-47d0-b95e-0bf65fcbdd5d-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:28:23 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-449105a2-85cf-4725-b4ce-e4438d39ef3b Jun 02 16:28:23 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:24 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-449105a2-85cf-4725-b4ce-e4438d39ef3b" returned: 0 in 0.753s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-449105a2-85cf-4725-b4ce-e4438d39ef3b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:24 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-449105a2-85cf-4725-b4ce-e4438d39ef3b Jun 02 16:28:24 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:24 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-449105a2-85cf-4725-b4ce-e4438d39ef3b" returned: 0 in 0.632s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] Lock "cinder-quobyte-449105a2-85cf-4725-b4ce-e4438d39ef3b" released by "delete_volume" :: held 1.424s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:28:24 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] Created reservations ['de323376-0e94-4793-9594-d472e1ff2cd4', 'ed83f372-6c0f-4af3-8c38-15afca439803', '2540501c-8742-40d7-a7e7-c8a39a215b84', '3ca073e7-90d8-4033-ac34-4ca76916047b'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:28:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:28:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:28:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:28:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:28:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:28:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:24 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:28:24 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:25 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.592s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:25 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:28:25 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] Deleted volume successfully. Jun 02 16:28:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0ebad761-25c6-405e-83fa-df13a89563c0 tempest-VolumeDependencyTests-878234146 None] Lock "cinder-449105a2-85cf-4725-b4ce-e4438d39ef3b-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:28:34 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=33,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=10 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:28:35 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=33,cinder:UPDATE=38,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:28:41 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:28:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Flow 'volume_create_manager' (6ee2073e-8e16-4eda-90e7-a3d240a44fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:28:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68c2d1e-4f0b-48f3-a3d5-3927cc794996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68c2d1e-4f0b-48f3-a3d5-3927cc794996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161f0178-308f-4ae8-a356-e9d13488e0fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76e54ee91f44a7d8f2daeab7457359c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:28:42Z,use_quota=True,user_id='fb88bbcc567640fca1dcab8a7f29d82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0bbc0e3-bfb2-4d82-9c5c-90c7531936c8),volume_type_id=c0bbc0e3-bfb2-4d82-9c5c-90c7531936c8)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e7ff39-6a8b-446c-91c5-418eef6191c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e7ff39-6a8b-446c-91c5-418eef6191c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed11dff-d45d-4f8f-b128-d05dc879c72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:41 devstack cinder-volume[86488]: DEBUG cinder.image.glance [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Creating Keystone auth plugin from conf {{(pid=86488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 16:28:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed11dff-d45d-4f8f-b128-d05dc879c72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '161f0178-308f-4ae8-a356-e9d13488e0fb', 'volume_name': 'volume-161f0178-308f-4ae8-a356-e9d13488e0fb', 'volume_size': 1, 'image_id': '88d3c425-2b29-4b7e-9bf2-569c081db65f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88d3c425-2b29-4b7e-9bf2-569c081db65f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '764f4ec138cd67d293ed0f9cea194fd1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b76e54ee91f44a7d8f2daeab7457359c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c13b7cdb5ee68d47e64db6b6c2847a110ad7dd795c69c6c0ae75aacbba6a568812135122c02d41ba2322543da15c615d806cff99d770bbe2cafb82fc7e638c1', 'id': '88d3c425-2b29-4b7e-9bf2-569c081db65f', 'created_at': datetime.datetime(2026, 6, 2, 14, 28, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88d3c425-2b29-4b7e-9bf2-569c081db65f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f4baf6-4501-4c02-bd39-e4c6d0a925c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f4baf6-4501-4c02-bd39-e4c6d0a925c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:41 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a216c23f-160a-4509-b19c-e774d26b07f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:41 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Volume 161f0178-308f-4ae8-a356-e9d13488e0fb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-161f0178-308f-4ae8-a356-e9d13488e0fb', 'volume_size': 1, 'image_id': '88d3c425-2b29-4b7e-9bf2-569c081db65f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88d3c425-2b29-4b7e-9bf2-569c081db65f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '764f4ec138cd67d293ed0f9cea194fd1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b76e54ee91f44a7d8f2daeab7457359c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c13b7cdb5ee68d47e64db6b6c2847a110ad7dd795c69c6c0ae75aacbba6a568812135122c02d41ba2322543da15c615d806cff99d770bbe2cafb82fc7e638c1', 'id': '88d3c425-2b29-4b7e-9bf2-569c081db65f', 'created_at': datetime.datetime(2026, 6, 2, 14, 28, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88d3c425-2b29-4b7e-9bf2-569c081db65f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 02 16:28:41 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Trying to clone 161f0178-308f-4ae8-a356-e9d13488e0fb from image 88d3c425-2b29-4b7e-9bf2-569c081db65f at location (None, [{'url': 'file:///opt/stack/data/glance/images/88d3c425-2b29-4b7e-9bf2-569c081db65f', 'metadata': {}}]). {{(pid=86488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 02 16:28:42 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 16:28:42 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Image download 0.00 MB at 0.00 MB/s Jun 02 16:28:42 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[725b933e-ba91-428a-a8c4-3a744d5f7800]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:28:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:42 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD Jun 02 16:28:42 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:42 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD" returned: 0 in 0.658s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:42 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD Jun 02 16:28:42 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:43 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD" returned: 1 in 0.648s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:28:43 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Temporary image 88d3c425-2b29-4b7e-9bf2-569c081db65f is fetched for user fb88bbcc567640fca1dcab8a7f29d82d. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 16:28:43 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[867d9a1f-7eb0-4a84-b254-ca853f303a97]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:28:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:43 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD Jun 02 16:28:43 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:44 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD" returned: 0 in 0.677s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:44 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD Jun 02 16:28:44 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:44 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD" returned: 1 in 0.658s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:28:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:28:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:28:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161f0178-308f-4ae8-a356-e9d13488e0fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76e54ee91f44a7d8f2daeab7457359c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:28:42Z,use_quota=True,user_id='fb88bbcc567640fca1dcab8a7f29d82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0bbc0e3-bfb2-4d82-9c5c-90c7531936c8),volume_type_id=c0bbc0e3-bfb2-4d82-9c5c-90c7531936c8)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:28:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Creating volume 161f0178-308f-4ae8-a356-e9d13488e0fb {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:28:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:28:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:28:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:28:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:28:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:28:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:28:44 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:28:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:44 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb 1073741824 Jun 02 16:28:44 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:45 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb 1073741824" returned: 0 in 0.775s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:45 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb Jun 02 16:28:45 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:46 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb" returned: 0 in 0.598s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:46 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:28:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:28:46 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Attempting download of 88d3c425-2b29-4b7e-9bf2-569c081db65f ((None, [{'url': 'file:///opt/stack/data/glance/images/88d3c425-2b29-4b7e-9bf2-569c081db65f', 'metadata': {}}])) to volume 161f0178-308f-4ae8-a356-e9d13488e0fb. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 16:28:46 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea540ba1-3bd5-40dd-b078-d75baac4e3a1]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:28:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88d3c425-2b29-4b7e-9bf2-569c081db65f_2vo_poqa {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:46 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88d3c425-2b29-4b7e-9bf2-569c081db65f_2vo_poqa Jun 02 16:28:46 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:46 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88d3c425-2b29-4b7e-9bf2-569c081db65f_2vo_poqa" returned: 0 in 0.682s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88d3c425-2b29-4b7e-9bf2-569c081db65f_2vo_poqa {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:47 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88d3c425-2b29-4b7e-9bf2-569c081db65f_2vo_poqa Jun 02 16:28:47 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:47 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88d3c425-2b29-4b7e-9bf2-569c081db65f_2vo_poqa" returned: 1 in 0.659s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88d3c425-2b29-4b7e-9bf2-569c081db65f_2vo_poqa' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:28:47 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd45e7df-1baa-430f-8bed-23323b2b40d3]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:28:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:47 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD Jun 02 16:28:47 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:48 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD" returned: 0 in 0.659s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:48 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD Jun 02 16:28:48 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:48 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD" returned: 1 in 0.658s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:28:48 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] 88d3c425-2b29-4b7e-9bf2-569c081db65f was raw, converting to raw {{(pid=86488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 16:28:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:49 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb Jun 02 16:28:49 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:49 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb" returned: 0 in 0.676s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:49 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_88d3c425-2b29-4b7e-9bf2-569c081db65f_cocx_0dcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:28:49 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Converted 0.00 MB image at 0.00 MB/s Jun 02 16:28:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:49 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb 1G Jun 02 16:28:49 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:50 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb 1G" returned: 0 in 0.609s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:50 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b995524-65aa-4b1c-8c24-70d58d99a5b2]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:28:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:50 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb Jun 02 16:28:50 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:50 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb" returned: 0 in 0.690s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:51 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb Jun 02 16:28:51 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:51 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb" returned: 1 in 0.692s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:28:51 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Downloaded image 88d3c425-2b29-4b7e-9bf2-569c081db65f ((None, [{'url': 'file:///opt/stack/data/glance/images/88d3c425-2b29-4b7e-9bf2-569c081db65f', 'metadata': {}}])) to volume 161f0178-308f-4ae8-a356-e9d13488e0fb successfully. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 16:28:51 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Temporary image 88d3c425-2b29-4b7e-9bf2-569c081db65f for user fb88bbcc567640fca1dcab8a7f29d82d is deleted. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 16:28:51 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Marking volume 161f0178-308f-4ae8-a356-e9d13488e0fb as bootable. {{(pid=86488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 16:28:51 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Copying metadata from image 88d3c425-2b29-4b7e-9bf2-569c081db65f to 161f0178-308f-4ae8-a356-e9d13488e0fb. {{(pid=86488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 16:28:51 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Creating volume glance metadata for volume 161f0178-308f-4ae8-a356-e9d13488e0fb backed by image 88d3c425-2b29-4b7e-9bf2-569c081db65f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '88d3c425-2b29-4b7e-9bf2-569c081db65f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '764f4ec138cd67d293ed0f9cea194fd1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 16:28:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a216c23f-160a-4509-b19c-e774d26b07f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-161f0178-308f-4ae8-a356-e9d13488e0fb', 'volume_size': 1, 'image_id': '88d3c425-2b29-4b7e-9bf2-569c081db65f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88d3c425-2b29-4b7e-9bf2-569c081db65f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '764f4ec138cd67d293ed0f9cea194fd1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b76e54ee91f44a7d8f2daeab7457359c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c13b7cdb5ee68d47e64db6b6c2847a110ad7dd795c69c6c0ae75aacbba6a568812135122c02d41ba2322543da15c615d806cff99d770bbe2cafb82fc7e638c1', 'id': '88d3c425-2b29-4b7e-9bf2-569c081db65f', 'created_at': datetime.datetime(2026, 6, 2, 14, 28, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88d3c425-2b29-4b7e-9bf2-569c081db65f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c435e0c0-d767-4e96-a3c1-3f895d6e7669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:28:51 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Volume volume-161f0178-308f-4ae8-a356-e9d13488e0fb (161f0178-308f-4ae8-a356-e9d13488e0fb): created successfully Jun 02 16:28:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c435e0c0-d767-4e96-a3c1-3f895d6e7669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:28:51 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Flow 'volume_create_manager' (6ee2073e-8e16-4eda-90e7-a3d240a44fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:28:51 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-ae1e3804-22a8-453e-97ce-d29fcd26138a tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Created volume successfully. Jun 02 16:28:52 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Acquiring lock "cinder-161f0178-308f-4ae8-a356-e9d13488e0fb-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:28:52 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Lock "cinder-161f0178-308f-4ae8-a356-e9d13488e0fb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:28:52 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Acquiring lock "cinder-quobyte-161f0178-308f-4ae8-a356-e9d13488e0fb" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:28:52 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Lock "cinder-quobyte-161f0178-308f-4ae8-a356-e9d13488e0fb" acquired by "delete_volume" :: waited 0.014s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:28:52 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78763ef-c029-4d38-a467-57c95ca143c6]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:28:52 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:52 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb Jun 02 16:28:52 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:53 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb" returned: 0 in 0.671s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:53 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb Jun 02 16:28:53 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:53 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb" returned: 1 in 0.665s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:28:53 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:53 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb Jun 02 16:28:53 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:54 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-161f0178-308f-4ae8-a356-e9d13488e0fb" returned: 0 in 0.562s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:54 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Lock "cinder-quobyte-161f0178-308f-4ae8-a356-e9d13488e0fb" released by "delete_volume" :: held 1.952s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:28:54 devstack cinder-volume[86488]: WARNING cinder.quota [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:28:54 devstack cinder-volume[86488]: WARNING cinder.quota [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 02 16:28:54 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Created reservations ['19e54c51-1a7f-4377-bf72-a3beb414380b', 'e3ad6fe3-4a49-4001-932b-f0d9d1bda8a8', '56ae93e9-50fc-4efa-85a3-5751c1983158', 'f2288c4c-345f-41f1-93ce-2274760e4ef6'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:28:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:28:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:28:54 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:28:54 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:28:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:28:54 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:28:54 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:28:54 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:28:55 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jun 02 16:28:55 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.606s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:28:55 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:28:55 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Deleted volume successfully. Jun 02 16:28:55 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ce0e04a8-eadb-4854-80bb-b9ffa6e2c7cf tempest-VolumeAndVolumeTypeFromImageTest-868641590 None] Lock "cinder-161f0178-308f-4ae8-a356-e9d13488e0fb-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:29:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:29:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:29:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:29:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:29:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:29:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:29:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:00 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:29:00 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:00 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.603s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:00 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:29:04 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:UPDATE=10,cinder:SELECT=13,cinder:INSERT=6 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:29:05 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=13,cinder:INSERT=9,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Flow 'volume_create_manager' (c09b32d0-f552-4bf6-ad02-b9e20b5301ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74cf6ae-a91b-47b3-898a-b2109f3a8a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74cf6ae-a91b-47b3-898a-b2109f3a8a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1467428119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d81ae13-d2f5-44f0-9790-9126f363c88b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3df5f3356b641f0b38d660726239549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:29:19Z,use_quota=True,user_id='0989f3f2fb804275b56a91d277bec3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369a6eb3-e171-4e9a-9c05-95616b7982af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369a6eb3-e171-4e9a-9c05-95616b7982af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912c36d0-4402-420d-af47-a5a41583e6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912c36d0-4402-420d-af47-a5a41583e6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d81ae13-d2f5-44f0-9790-9126f363c88b', 'volume_name': 'volume-8d81ae13-d2f5-44f0-9790-9126f363c88b', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa033063-8bc8-43bc-8e6a-059a4d5499a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa033063-8bc8-43bc-8e6a-059a4d5499a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9eb558e-7615-404a-b860-3f0f387f42bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:29:18 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Volume 8d81ae13-d2f5-44f0-9790-9126f363c88b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d81ae13-d2f5-44f0-9790-9126f363c88b', 'volume_size': 1} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1467428119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d81ae13-d2f5-44f0-9790-9126f363c88b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3df5f3356b641f0b38d660726239549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:29:19Z,use_quota=True,user_id='0989f3f2fb804275b56a91d277bec3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Creating volume 8d81ae13-d2f5-44f0-9790-9126f363c88b {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:29:18 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:29:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:18 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b 1073741824 Jun 02 16:29:18 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:19 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b 1073741824" returned: 0 in 0.814s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:19 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b Jun 02 16:29:19 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:20 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b" returned: 0 in 0.631s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:29:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:29:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9eb558e-7615-404a-b860-3f0f387f42bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d81ae13-d2f5-44f0-9790-9126f363c88b', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:29:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5832d733-813e-4f81-a304-1d2a06d54184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:29:20 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Volume volume-8d81ae13-d2f5-44f0-9790-9126f363c88b (8d81ae13-d2f5-44f0-9790-9126f363c88b): created successfully Jun 02 16:29:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5832d733-813e-4f81-a304-1d2a06d54184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:29:20 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Flow 'volume_create_manager' (c09b32d0-f552-4bf6-ad02-b9e20b5301ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:29:20 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-7d8698de-3516-4126-9d0d-b31b5f9a72ba tempest-SnapshotDependencyTests-1558545729 None] Created volume successfully. Jun 02 16:29:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:29:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:29:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] Creating offline snapshot 1e61bd12-8be3-43e3-a62f-7248260e1396 of volume 8d81ae13-d2f5-44f0-9790-9126f363c88b {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:29:21 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9d3806-0719-49ba-96df-bdd9f0ed79d2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:29:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:21 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b Jun 02 16:29:21 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:21 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b" returned: 0 in 0.728s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:21 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396 1G Jun 02 16:29:21 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:22 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396 1G" returned: 0 in 0.770s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d81ae13-d2f5-44f0-9790-9126f363c88b -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:22 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d81ae13-d2f5-44f0-9790-9126f363c88b -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396 Jun 02 16:29:22 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:23 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d81ae13-d2f5-44f0-9790-9126f363c88b -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396" returned: 0 in 0.638s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:23 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396 is being set with open permissions: ugo+rw Jun 02 16:29:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:23 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396 Jun 02 16:29:23 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:23 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396" returned: 0 in 0.604s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:24 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.info Jun 02 16:29:24 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:24 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.info" returned: 0 in 0.652s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:24 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.info is being set with open permissions: ugo+rw Jun 02 16:29:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:24 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.info Jun 02 16:29:24 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:25 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.info" returned: 0 in 0.581s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.069s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:29:25 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-b7a905b3-8380-4a99-8ed5-fb284db71404 tempest-SnapshotDependencyTests-1558545729 None] Create snapshot completed successfully Jun 02 16:29:25 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:29:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Flow 'volume_create_manager' (756640f6-8724-42f2-9c25-a1e00f541d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:29:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0501ca-6125-4bd6-93f5-9ac00d6338ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:29:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0501ca-6125-4bd6-93f5-9ac00d6338ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24693349-b2c3-47f5-a1de-7cc3f78e6d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3df5f3356b641f0b38d660726239549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1e61bd12-8be3-43e3-a62f-7248260e1396,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:29:26Z,use_quota=True,user_id='0989f3f2fb804275b56a91d277bec3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:29:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3370ab1-d950-4565-b8bd-299d40bb14fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:29:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3370ab1-d950-4565-b8bd-299d40bb14fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69aefa8f-b13e-4634-ad98-e905c55aaf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69aefa8f-b13e-4634-ad98-e905c55aaf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '24693349-b2c3-47f5-a1de-7cc3f78e6d30', 'volume_name': 'volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30', 'volume_size': 1, 'snapshot_id': '1e61bd12-8be3-43e3-a62f-7248260e1396'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b06b64b-0fd8-4738-a2d6-78f74a05bd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b06b64b-0fd8-4738-a2d6-78f74a05bd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384c5435-c1cc-44d5-a189-e3a597dbd0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:29:26 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Volume 24693349-b2c3-47f5-a1de-7cc3f78e6d30: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30', 'volume_size': 1, 'snapshot_id': '1e61bd12-8be3-43e3-a62f-7248260e1396'} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Acquiring lock "cinder-quobyte-1e61bd12-8be3-43e3-a62f-7248260e1396-24693349-b2c3-47f5-a1de-7cc3f78e6d30" by "_create_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-quobyte-1e61bd12-8be3-43e3-a62f-7248260e1396-24693349-b2c3-47f5-a1de-7cc3f78e6d30" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Creating volume 24693349-b2c3-47f5-a1de-7cc3f78e6d30 from snapshot 1e61bd12-8be3-43e3-a62f-7248260e1396 {{(pid=86488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Acquiring lock "cinder-quobyte-24693349-b2c3-47f5-a1de-7cc3f78e6d30" by "_copy_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-quobyte-24693349-b2c3-47f5-a1de-7cc3f78e6d30" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] snapshot: 1e61bd12-8be3-43e3-a62f-7248260e1396, volume: 24693349-b2c3-47f5-a1de-7cc3f78e6d30, {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[032d1b53-c2b9-4ca1-8ec5-7d88083af6c8]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:26 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396 Jun 02 16:29:26 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:26 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396" returned: 0 in 0.732s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d81ae13-d2f5-44f0-9790-9126f363c88b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Creating direct copy from snapshot {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e122bb4a-2180-467e-86a8-3685c840e042]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:29:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:26 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b Jun 02 16:29:26 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:27 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b" returned: 0 in 0.731s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:27 devstack cinder-volume[86488]: DEBUG cinder.utils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Path /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30 not found in is_blk_device check {{(pid=86488) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 16:29:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:27 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30 Jun 02 16:29:27 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:32 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30" returned: 0 in 4.411s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:32 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3327b4dc-0336-4f82-917f-2045ea91a8e2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:29:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:32 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b Jun 02 16:29:32 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:32 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b" returned: 0 in 0.825s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:32 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Image conversion details: src /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b, size 1024.00 MB, duration 4.41 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30 {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:29:32 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Converted 1024.00 MB image at 232.09 MB/s Jun 02 16:29:32 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30 is being set with open permissions: ugo+rw Jun 02 16:29:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:32 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30 Jun 02 16:29:32 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:33 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30" returned: 0 in 0.565s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-quobyte-24693349-b2c3-47f5-a1de-7cc3f78e6d30" released by "_copy_volume_from_snapshot" :: held 7.355s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-quobyte-1e61bd12-8be3-43e3-a62f-7248260e1396-24693349-b2c3-47f5-a1de-7cc3f78e6d30" released by "_create_volume_from_snapshot" :: held 7.385s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.402s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384c5435-c1cc-44d5-a189-e3a597dbd0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30', 'volume_size': 1, 'snapshot_id': '1e61bd12-8be3-43e3-a62f-7248260e1396'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb99a05-3e29-461c-9fe2-b152817463a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:29:33 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Volume volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30 (24693349-b2c3-47f5-a1de-7cc3f78e6d30): created successfully Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb99a05-3e29-461c-9fe2-b152817463a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Flow 'volume_create_manager' (756640f6-8724-42f2-9c25-a1e00f541d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:29:33 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-ca3e214d-c44d-461d-b6f5-5592c6e5f02e tempest-SnapshotDependencyTests-1558545729 None] Created volume successfully. Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] Acquiring lock "cinder-1e61bd12-8be3-43e3-a62f-7248260e1396-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-1e61bd12-8be3-43e3-a62f-7248260e1396-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] Acquiring lock "cinder-quobyte-8d81ae13-d2f5-44f0-9790-9126f363c88b" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-quobyte-8d81ae13-d2f5-44f0-9790-9126f363c88b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] Acquiring lock "cinder-quobyte-1e61bd12-8be3-43e3-a62f-7248260e1396" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-quobyte-1e61bd12-8be3-43e3-a62f-7248260e1396" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] Deleting offline snapshot 1e61bd12-8be3-43e3-a62f-7248260e1396 of volume 8d81ae13-d2f5-44f0-9790-9126f363c88b {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] snapshot_file for this snap is: volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fb90f4-3ca2-43cc-ab70-a1dcaaaec0c1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:29:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:33 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396 Jun 02 16:29:33 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:34 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396" returned: 0 in 0.699s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d81ae13-d2f5-44f0-9790-9126f363c88b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:29:34 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfb8bec-3f8b-4d7a-a9fa-23206ad905d1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:29:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:34 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b Jun 02 16:29:34 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:35 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b" returned: 0 in 0.684s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:35 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396 Jun 02 16:29:35 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:35 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396" returned: 0 in 0.671s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:35 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396 Jun 02 16:29:35 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:36 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b.1e61bd12-8be3-43e3-a62f-7248260e1396" returned: 0 in 0.577s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-quobyte-1e61bd12-8be3-43e3-a62f-7248260e1396" released by "_delete_snapshot" :: held 2.725s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:29:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-quobyte-8d81ae13-d2f5-44f0-9790-9126f363c88b" released by "delete_snapshot" :: held 2.746s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:29:36 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] Created reservations ['7b6368b5-bbb2-41e6-ac8e-37d9251fab7a', 'bac4466c-2251-4037-8fb6-159e87d30172', 'c3a38701-0970-4761-abd8-e985694ac988', 'bcf8bf66-ce96-4fee-921d-edc49e78a2ad'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:29:36 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] Delete snapshot completed successfully. Jun 02 16:29:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8dbf99d6-4523-4121-a949-3ebc631c66ae tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-1e61bd12-8be3-43e3-a62f-7248260e1396-delete_snapshot" released by "delete_snapshot" :: held 2.873s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:29:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] Acquiring lock "cinder-8d81ae13-d2f5-44f0-9790-9126f363c88b-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:29:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-8d81ae13-d2f5-44f0-9790-9126f363c88b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:29:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] Acquiring lock "cinder-quobyte-8d81ae13-d2f5-44f0-9790-9126f363c88b" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:29:36 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-quobyte-8d81ae13-d2f5-44f0-9790-9126f363c88b" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:29:36 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2ca029-8cc8-4a38-9183-a72d7e44e932]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:29:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:37 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b Jun 02 16:29:37 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:37 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b" returned: 0 in 0.689s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:37 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b Jun 02 16:29:37 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:38 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8d81ae13-d2f5-44f0-9790-9126f363c88b" returned: 0 in 0.574s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:38 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-quobyte-8d81ae13-d2f5-44f0-9790-9126f363c88b" released by "delete_volume" :: held 1.330s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:29:38 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] Created reservations ['a8b4f8cb-ecf5-4b35-8039-a406f1d8454d', '37a14426-b510-42d6-ba2a-60eae242bdcc', '5d4b98be-b4c7-414c-8674-e348fe5771e9', '58d35386-3336-4bc9-8703-78f856de6608'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:29:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:29:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:29:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:29:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:29:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:29:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:38 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:29:38 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:38 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.628s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:38 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:29:38 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] Deleted volume successfully. Jun 02 16:29:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-cde84722-8048-4d2f-9c8d-9c4acb7cea24 tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-8d81ae13-d2f5-44f0-9790-9126f363c88b-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:29:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] Acquiring lock "cinder-24693349-b2c3-47f5-a1de-7cc3f78e6d30-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:29:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-24693349-b2c3-47f5-a1de-7cc3f78e6d30-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:29:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] Acquiring lock "cinder-quobyte-24693349-b2c3-47f5-a1de-7cc3f78e6d30" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:29:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-quobyte-24693349-b2c3-47f5-a1de-7cc3f78e6d30" acquired by "delete_volume" :: waited 0.016s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:29:39 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6452295-caf7-406e-9edc-7ffe2e7f730e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:29:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:39 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30 Jun 02 16:29:39 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:39 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30" returned: 0 in 0.739s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:39 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30 Jun 02 16:29:39 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:40 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-24693349-b2c3-47f5-a1de-7cc3f78e6d30" returned: 0 in 0.614s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-quobyte-24693349-b2c3-47f5-a1de-7cc3f78e6d30" released by "delete_volume" :: held 1.397s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:29:40 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] Created reservations ['2704d221-10f9-4bdf-b4e3-9965c5073a01', 'd705d67d-25de-4dd0-b569-60da72706923', '386695b1-3146-4129-b69b-d72fbd884a4e', '2014c59b-a001-4d97-8f98-f3816aaab199'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:29:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:29:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:29:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:29:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:29:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:29:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:29:40 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:29:40 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:29:41 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jun 02 16:29:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.586s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:29:41 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:29:41 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] Deleted volume successfully. Jun 02 16:29:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-41ad1803-c77a-4e13-8091-1a8f1fe8addd tempest-SnapshotDependencyTests-1558545729 None] Lock "cinder-24693349-b2c3-47f5-a1de-7cc3f78e6d30-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:29:50 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=26,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:29:51 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=21,cinder:UPDATE=31,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:00 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:30:00 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Flow 'volume_create_manager' (1ef99543-7666-4a09-83bc-d4d1a4849a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0136f3d-960b-44dc-b081-6bdce3dd2598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0136f3d-960b-44dc-b081-6bdce3dd2598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-772094885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c594979-1de4-4444-aebc-1d7e7e62b9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f36c73e06734cc89a6dc6868a3370f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:01Z,use_quota=True,user_id='18d94968176c4ff983f96332629b98fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28f9afb-c903-4643-96e9-8d0baf707694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28f9afb-c903-4643-96e9-8d0baf707694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2d9bea-4755-48f0-8cba-f406548cf0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2d9bea-4755-48f0-8cba-f406548cf0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c594979-1de4-4444-aebc-1d7e7e62b9ba', 'volume_name': 'volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd245874-7665-4fad-9fa9-f6c6de7c340d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd245874-7665-4fad-9fa9-f6c6de7c340d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7a6db2-ba19-4fd7-8890-d842c63d588d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:00 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume 6c594979-1de4-4444-aebc-1d7e7e62b9ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba', 'volume_size': 1} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-772094885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c594979-1de4-4444-aebc-1d7e7e62b9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f36c73e06734cc89a6dc6868a3370f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:01Z,use_quota=True,user_id='18d94968176c4ff983f96332629b98fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Creating volume 6c594979-1de4-4444-aebc-1d7e7e62b9ba {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:00 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:30:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:00 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba 1073741824 Jun 02 16:30:00 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:01 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.044s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Flow 'volume_create_manager' (6ca590b1-219b-4b34-9afa-e21d2613629c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631fa12d-b07b-4971-904d-b460d9475f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631fa12d-b07b-4971-904d-b460d9475f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1712894612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e81d9e20-18f0-46b2-8a21-3057dea3abd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3909650a8a534d258f1bcdca91e73640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:01Z,use_quota=True,user_id='1c0eb59b5737496fb8c19175d9a0d642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e99923-04a5-4b1d-acd5-616b36fa7476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e99923-04a5-4b1d-acd5-616b36fa7476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6b8b97-48a4-4084-8235-4e8f50cd52cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6b8b97-48a4-4084-8235-4e8f50cd52cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e81d9e20-18f0-46b2-8a21-3057dea3abd3', 'volume_name': 'volume-e81d9e20-18f0-46b2-8a21-3057dea3abd3', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07ed8bc-9bf2-4449-9bda-c044009d4b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07ed8bc-9bf2-4449-9bda-c044009d4b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbf79bf1-36c0-418c-af60-8d1fe9e1bd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:01 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Volume e81d9e20-18f0-46b2-8a21-3057dea3abd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e81d9e20-18f0-46b2-8a21-3057dea3abd3', 'volume_size': 1} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Flow 'volume_create_manager' (3373b9c5-fe69-410c-a5c3-f30139c43c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ff0b93-5b4b-45d6-b4d3-b6cacee99850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ff0b93-5b4b-45d6-b4d3-b6cacee99850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fca44d7-a30c-41d5-b802-14d20e00153a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32440b66ba3421a902036377e22dfc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:02Z,use_quota=True,user_id='a2b1a816be75456486568deb2be2778d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03df9922-ac21-4d60-8b4f-d7e6c12b2c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03df9922-ac21-4d60-8b4f-d7e6c12b2c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe78ab9-b6a4-4415-baa9-cd4e10c070a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe78ab9-b6a4-4415-baa9-cd4e10c070a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fca44d7-a30c-41d5-b802-14d20e00153a', 'volume_name': 'volume-5fca44d7-a30c-41d5-b802-14d20e00153a', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b35c97b-b32d-4aad-b0ba-19e70278665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b35c97b-b32d-4aad-b0ba-19e70278665e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff373a9-8f80-45d6-b947-d2556f3f4d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:01 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Volume 5fca44d7-a30c-41d5-b802-14d20e00153a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fca44d7-a30c-41d5-b802-14d20e00153a', 'volume_size': 1} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Flow 'volume_create_manager' (321361fa-287e-4f26-9061-6f74e9aceb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd67ba4-bf32-4f81-8f9d-c64ad3e10581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd67ba4-bf32-4f81-8f9d-c64ad3e10581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-268145667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27fee05-1b6b-441a-a6c1-9881b050dd44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3909650a8a534d258f1bcdca91e73640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:02Z,use_quota=True,user_id='1c0eb59b5737496fb8c19175d9a0d642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f948c35a-afde-4c01-bd07-4b3775081ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f948c35a-afde-4c01-bd07-4b3775081ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a6e242-24a9-4e84-8ed7-7cb28c85ec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a6e242-24a9-4e84-8ed7-7cb28c85ec76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd27fee05-1b6b-441a-a6c1-9881b050dd44', 'volume_name': 'volume-d27fee05-1b6b-441a-a6c1-9881b050dd44', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f78a916-b4e6-48b6-8698-d6017262b1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f78a916-b4e6-48b6-8698-d6017262b1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f5bdb2-5a06-443c-b4df-8eb1934bf42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:01 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Volume d27fee05-1b6b-441a-a6c1-9881b050dd44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d27fee05-1b6b-441a-a6c1-9881b050dd44', 'volume_size': 1} Jun 02 16:30:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Flow 'volume_create_manager' (26e57f20-6061-4cf5-b10b-b18cac5d63db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:02 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c0185f-951c-446d-b587-1ff5f247a4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba 1073741824" returned: 0 in 1.280s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c0185f-951c-446d-b587-1ff5f247a4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-996277677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c1a9ff7-be77-4b80-b315-4b317b742ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3909650a8a534d258f1bcdca91e73640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:02Z,use_quota=True,user_id='1c0eb59b5737496fb8c19175d9a0d642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a43b6f-adf2-4800-97a5-1a7cbcf28593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a43b6f-adf2-4800-97a5-1a7cbcf28593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3820257-7e31-415c-8029-b5fd4755c917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3820257-7e31-415c-8029-b5fd4755c917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c1a9ff7-be77-4b80-b315-4b317b742ede', 'volume_name': 'volume-2c1a9ff7-be77-4b80-b315-4b317b742ede', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (162f4429-b2b5-461a-b794-95a8895c40d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (162f4429-b2b5-461a-b794-95a8895c40d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c42e51c-f786-4cf5-9aee-a6c01b15f351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:02 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Volume 2c1a9ff7-be77-4b80-b315-4b317b742ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c1a9ff7-be77-4b80-b315-4b317b742ede', 'volume_size': 1} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:02 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba Jun 02 16:30:02 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Flow 'volume_create_manager' (9f673b02-01c8-4699-a7cf-839c2a591361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c2d812-f4f5-42dd-aa64-46b8f789ad8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c2d812-f4f5-42dd-aa64-46b8f789ad8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1828101471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94abb97c-38cb-4f8a-963f-241a5286e5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3909650a8a534d258f1bcdca91e73640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:02Z,use_quota=True,user_id='1c0eb59b5737496fb8c19175d9a0d642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79734ae6-4848-4a2c-9b9b-a4f5d9848a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79734ae6-4848-4a2c-9b9b-a4f5d9848a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c13a55-f0e8-4952-a593-dbcc44eb9c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c13a55-f0e8-4952-a593-dbcc44eb9c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94abb97c-38cb-4f8a-963f-241a5286e5a9', 'volume_name': 'volume-94abb97c-38cb-4f8a-963f-241a5286e5a9', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e704f56d-f224-4154-90fb-84d747b30a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e704f56d-f224-4154-90fb-84d747b30a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58808e66-e16e-430e-bfc7-3526aa2eb376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:02 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Volume 94abb97c-38cb-4f8a-963f-241a5286e5a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94abb97c-38cb-4f8a-963f-241a5286e5a9', 'volume_size': 1} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Flow 'volume_create_manager' (c3b7e2f5-f9b6-485e-b3ab-9ff2cb7063dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c264de8-4047-490b-8590-52676dfcbf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c264de8-4047-490b-8590-52676dfcbf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1868250468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d12b178-9fc4-43b9-97a7-54400c0015d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3909650a8a534d258f1bcdca91e73640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:03Z,use_quota=True,user_id='1c0eb59b5737496fb8c19175d9a0d642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b4975c-27c5-4efd-8010-dc272d2bdfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b4975c-27c5-4efd-8010-dc272d2bdfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470bf947-5539-4541-80b4-93d10e179047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470bf947-5539-4541-80b4-93d10e179047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d12b178-9fc4-43b9-97a7-54400c0015d3', 'volume_name': 'volume-5d12b178-9fc4-43b9-97a7-54400c0015d3', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86c05c8-a0bf-4e5a-aca6-ea2c23b3b62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86c05c8-a0bf-4e5a-aca6-ea2c23b3b62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd5f546-5aec-4e6f-a3d1-77521fe12bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:03 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Volume 5d12b178-9fc4-43b9-97a7-54400c0015d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d12b178-9fc4-43b9-97a7-54400c0015d3', 'volume_size': 1} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:03 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba" returned: 0 in 0.809s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] <== create_volume: return (2213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.797s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1712894612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e81d9e20-18f0-46b2-8a21-3057dea3abd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3909650a8a534d258f1bcdca91e73640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:01Z,use_quota=True,user_id='1c0eb59b5737496fb8c19175d9a0d642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Creating volume e81d9e20-18f0-46b2-8a21-3057dea3abd3 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:03 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e81d9e20-18f0-46b2-8a21-3057dea3abd3 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:03 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e81d9e20-18f0-46b2-8a21-3057dea3abd3 1073741824 Jun 02 16:30:03 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7a6db2-ba19-4fd7-8890-d842c63d588d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ca98f6-6b11-479e-99f2-e457511cab28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:03 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba (6c594979-1de4-4444-aebc-1d7e7e62b9ba): created successfully Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ca98f6-6b11-479e-99f2-e457511cab28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Flow 'volume_create_manager' (1ef99543-7666-4a09-83bc-d4d1a4849a5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:03 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-74b8b28c-e13e-4266-b071-f10aaa08e64d tempest-CreateVolumesFromSnapshotTest-1613906066 None] Created volume successfully. Jun 02 16:30:04 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e81d9e20-18f0-46b2-8a21-3057dea3abd3 1073741824" returned: 0 in 0.915s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e81d9e20-18f0-46b2-8a21-3057dea3abd3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:04 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e81d9e20-18f0-46b2-8a21-3057dea3abd3 Jun 02 16:30:04 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:04 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e81d9e20-18f0-46b2-8a21-3057dea3abd3" returned: 0 in 0.692s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.974s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fca44d7-a30c-41d5-b802-14d20e00153a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32440b66ba3421a902036377e22dfc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:02Z,use_quota=True,user_id='a2b1a816be75456486568deb2be2778d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Creating volume 5fca44d7-a30c-41d5-b802-14d20e00153a {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:04 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fca44d7-a30c-41d5-b802-14d20e00153a 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:04 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fca44d7-a30c-41d5-b802-14d20e00153a 1073741824 Jun 02 16:30:04 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbf79bf1-36c0-418c-af60-8d1fe9e1bd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e81d9e20-18f0-46b2-8a21-3057dea3abd3', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9026574-eb91-4368-9c12-e2ac523900cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:04 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Volume volume-e81d9e20-18f0-46b2-8a21-3057dea3abd3 (e81d9e20-18f0-46b2-8a21-3057dea3abd3): created successfully Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9026574-eb91-4368-9c12-e2ac523900cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Flow 'volume_create_manager' (6ca590b1-219b-4b34-9afa-e21d2613629c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:04 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-08222452-5ae5-45aa-a7a2-7d09302a8a75 tempest-CreateVolumesFromImageTest-997429841 None] Created volume successfully. Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Flow 'volume_create_manager' (f9dd29f6-85d3-462f-bbe3-a1fecdec96b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260fa7e8-7558-4fd7-8b89-6b0e203c200f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260fa7e8-7558-4fd7-8b89-6b0e203c200f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059370b3-6eed-4736-8020-904bc0d0cbe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cface15d5014801bbec9461209c9317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:05Z,use_quota=True,user_id='22e6c3b0df74435db2a65f6bfaaa727f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d06d08a4-b16a-4707-bb6a-3243a2362b57),volume_type_id=d06d08a4-b16a-4707-bb6a-3243a2362b57)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7125f3ed-822d-4284-9d66-9356d2cdde0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7125f3ed-822d-4284-9d66-9356d2cdde0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b937cf14-06f2-4acc-9ed8-b65a34710152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG cinder.image.glance [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Creating Keystone auth plugin from conf {{(pid=86488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b937cf14-06f2-4acc-9ed8-b65a34710152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '059370b3-6eed-4736-8020-904bc0d0cbe7', 'volume_name': 'volume-059370b3-6eed-4736-8020-904bc0d0cbe7', 'volume_size': 1, 'image_id': '92a7d3fa-39fc-4d5e-9714-aeec345adf3a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92a7d3fa-39fc-4d5e-9714-aeec345adf3a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a649497220ee8ff46140e5b851245ec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8cface15d5014801bbec9461209c9317', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8838952c1e64f8eee06713c4cfebaeeb37c8cb7884bbd2b360b9cb890f8bcf0315ef9c42f87c9115b44fbc21c9e886475950c5606506f672ff4ca6a95855c7ff', 'id': '92a7d3fa-39fc-4d5e-9714-aeec345adf3a', 'created_at': datetime.datetime(2026, 6, 2, 14, 30, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 30, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92a7d3fa-39fc-4d5e-9714-aeec345adf3a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ac71f6-4850-427f-95d8-ef031697a5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ac71f6-4850-427f-95d8-ef031697a5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7555c406-2223-47ca-9150-0e8479ff3ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:05 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Volume 059370b3-6eed-4736-8020-904bc0d0cbe7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-059370b3-6eed-4736-8020-904bc0d0cbe7', 'volume_size': 1, 'image_id': '92a7d3fa-39fc-4d5e-9714-aeec345adf3a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92a7d3fa-39fc-4d5e-9714-aeec345adf3a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a649497220ee8ff46140e5b851245ec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8cface15d5014801bbec9461209c9317', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8838952c1e64f8eee06713c4cfebaeeb37c8cb7884bbd2b360b9cb890f8bcf0315ef9c42f87c9115b44fbc21c9e886475950c5606506f672ff4ca6a95855c7ff', 'id': '92a7d3fa-39fc-4d5e-9714-aeec345adf3a', 'created_at': datetime.datetime(2026, 6, 2, 14, 30, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 30, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92a7d3fa-39fc-4d5e-9714-aeec345adf3a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Trying to clone 059370b3-6eed-4736-8020-904bc0d0cbe7 from image 92a7d3fa-39fc-4d5e-9714-aeec345adf3a at location (None, [{'url': 'file:///opt/stack/data/glance/images/92a7d3fa-39fc-4d5e-9714-aeec345adf3a', 'metadata': {}}]). {{(pid=86488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 16:30:05 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Image download 0.00 MB at 0.00 MB/s Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c04851-5189-4f1c-ba70-3035442bbc5e]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:05 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fca44d7-a30c-41d5-b802-14d20e00153a 1073741824" returned: 0 in 0.854s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fca44d7-a30c-41d5-b802-14d20e00153a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:05 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD Jun 02 16:30:05 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:05 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fca44d7-a30c-41d5-b802-14d20e00153a Jun 02 16:30:05 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:06 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fca44d7-a30c-41d5-b802-14d20e00153a" returned: 0 in 0.610s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.374s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-268145667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27fee05-1b6b-441a-a6c1-9881b050dd44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3909650a8a534d258f1bcdca91e73640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:02Z,use_quota=True,user_id='1c0eb59b5737496fb8c19175d9a0d642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Creating volume d27fee05-1b6b-441a-a6c1-9881b050dd44 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:06 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:06 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d27fee05-1b6b-441a-a6c1-9881b050dd44 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD" returned: 0 in 0.766s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:06 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d27fee05-1b6b-441a-a6c1-9881b050dd44 1073741824 Jun 02 16:30:06 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff373a9-8f80-45d6-b947-d2556f3f4d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fca44d7-a30c-41d5-b802-14d20e00153a', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45272477-9901-4b10-81cf-f7f7986cade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:06 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Volume volume-5fca44d7-a30c-41d5-b802-14d20e00153a (5fca44d7-a30c-41d5-b802-14d20e00153a): created successfully Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45272477-9901-4b10-81cf-f7f7986cade1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Flow 'volume_create_manager' (3373b9c5-fe69-410c-a5c3-f30139c43c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:06 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-4cd05ec4-82ce-48e8-aee7-bca11c469706 tempest-CinderUnicodeTest-2129592764 None] Created volume successfully. Jun 02 16:30:06 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD Jun 02 16:30:06 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:07 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD" returned: 1 in 0.756s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Temporary image 92a7d3fa-39fc-4d5e-9714-aeec345adf3a is fetched for user 22e6c3b0df74435db2a65f6bfaaa727f. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1a2e36-796a-4a78-9825-37603109f6d0]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:07 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d27fee05-1b6b-441a-a6c1-9881b050dd44 1073741824" returned: 0 in 0.881s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d27fee05-1b6b-441a-a6c1-9881b050dd44 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:07 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d27fee05-1b6b-441a-a6c1-9881b050dd44 Jun 02 16:30:07 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:07 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD Jun 02 16:30:07 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Flow 'volume_create_manager' (b1bef9c7-8eba-4030-9ae1-5272b3bd2a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db500321-b228-4693-999c-3857e4a15397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db500321-b228-4693-999c-3857e4a15397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-360853275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716646e2-26e7-463e-8699-40217ae66fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32440b66ba3421a902036377e22dfc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:07Z,use_quota=True,user_id='a2b1a816be75456486568deb2be2778d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7622cdf9-1135-482c-a9b7-169e96110cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7622cdf9-1135-482c-a9b7-169e96110cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8634d268-8998-4d95-a5d1-628f2c75e9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8634d268-8998-4d95-a5d1-628f2c75e9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '716646e2-26e7-463e-8699-40217ae66fe9', 'volume_name': 'volume-716646e2-26e7-463e-8699-40217ae66fe9', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ade248-2619-43eb-a5fe-999fadd67a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ade248-2619-43eb-a5fe-999fadd67a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47184f08-18d5-4a07-9598-b040dc891b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:07 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Volume 716646e2-26e7-463e-8699-40217ae66fe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-716646e2-26e7-463e-8699-40217ae66fe9', 'volume_size': 1} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:07 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d27fee05-1b6b-441a-a6c1-9881b050dd44" returned: 0 in 0.657s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.628s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-996277677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c1a9ff7-be77-4b80-b315-4b317b742ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3909650a8a534d258f1bcdca91e73640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:02Z,use_quota=True,user_id='1c0eb59b5737496fb8c19175d9a0d642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Creating volume 2c1a9ff7-be77-4b80-b315-4b317b742ede {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:07 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c1a9ff7-be77-4b80-b315-4b317b742ede 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:07 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c1a9ff7-be77-4b80-b315-4b317b742ede 1073741824 Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f5bdb2-5a06-443c-b4df-8eb1934bf42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d27fee05-1b6b-441a-a6c1-9881b050dd44', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:07 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:07 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4db425-9c19-4e98-96fc-b443b27ff123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:07 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Volume volume-d27fee05-1b6b-441a-a6c1-9881b050dd44 (d27fee05-1b6b-441a-a6c1-9881b050dd44): created successfully Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4db425-9c19-4e98-96fc-b443b27ff123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Flow 'volume_create_manager' (321361fa-287e-4f26-9061-6f74e9aceb58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:07 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-1abf08bf-e697-42e6-874d-b8d97313cac0 tempest-CreateVolumesFromImageTest-997429841 None] Created volume successfully. Jun 02 16:30:08 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD Jun 02 16:30:08 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:08 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD" returned: 1 in 0.679s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:30:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:08 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c1a9ff7-be77-4b80-b315-4b317b742ede 1073741824" returned: 0 in 0.845s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c1a9ff7-be77-4b80-b315-4b317b742ede {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:08 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c1a9ff7-be77-4b80-b315-4b317b742ede Jun 02 16:30:08 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:09 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c1a9ff7-be77-4b80-b315-4b317b742ede" returned: 0 in 0.585s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:30:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.716s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1828101471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94abb97c-38cb-4f8a-963f-241a5286e5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3909650a8a534d258f1bcdca91e73640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:02Z,use_quota=True,user_id='1c0eb59b5737496fb8c19175d9a0d642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:30:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Creating volume 94abb97c-38cb-4f8a-963f-241a5286e5a9 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:30:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:09 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:30:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-94abb97c-38cb-4f8a-963f-241a5286e5a9 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:09 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c42e51c-f786-4cf5-9aee-a6c01b15f351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c1a9ff7-be77-4b80-b315-4b317b742ede', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:09 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-94abb97c-38cb-4f8a-963f-241a5286e5a9 1073741824 Jun 02 16:30:09 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:09 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09b72df-5272-4403-92b0-3bf030210842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:09 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Volume volume-2c1a9ff7-be77-4b80-b315-4b317b742ede (2c1a9ff7-be77-4b80-b315-4b317b742ede): created successfully Jun 02 16:30:09 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09b72df-5272-4403-92b0-3bf030210842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:09 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Flow 'volume_create_manager' (26e57f20-6061-4cf5-b10b-b18cac5d63db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:09 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-f4d739e7-9f48-49f6-8def-7a67c1b4c918 tempest-CreateVolumesFromImageTest-997429841 None] Created volume successfully. Jun 02 16:30:10 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-94abb97c-38cb-4f8a-963f-241a5286e5a9 1073741824" returned: 0 in 0.775s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-94abb97c-38cb-4f8a-963f-241a5286e5a9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:10 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-94abb97c-38cb-4f8a-963f-241a5286e5a9 Jun 02 16:30:10 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:10 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-94abb97c-38cb-4f8a-963f-241a5286e5a9" returned: 0 in 0.597s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.738s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1868250468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d12b178-9fc4-43b9-97a7-54400c0015d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3909650a8a534d258f1bcdca91e73640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:03Z,use_quota=True,user_id='1c0eb59b5737496fb8c19175d9a0d642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Creating volume 5d12b178-9fc4-43b9-97a7-54400c0015d3 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:10 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5d12b178-9fc4-43b9-97a7-54400c0015d3 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:10 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5d12b178-9fc4-43b9-97a7-54400c0015d3 1073741824 Jun 02 16:30:10 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58808e66-e16e-430e-bfc7-3526aa2eb376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94abb97c-38cb-4f8a-963f-241a5286e5a9', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175c5a94-3584-4b52-9d29-94ae4c29728d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:10 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Volume volume-94abb97c-38cb-4f8a-963f-241a5286e5a9 (94abb97c-38cb-4f8a-963f-241a5286e5a9): created successfully Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175c5a94-3584-4b52-9d29-94ae4c29728d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:10 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Flow 'volume_create_manager' (9f673b02-01c8-4699-a7cf-839c2a591361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:10 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-a8629ab0-6243-4756-aeec-9cbc1bbfdcc1 tempest-CreateVolumesFromImageTest-997429841 None] Created volume successfully. Jun 02 16:30:11 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5d12b178-9fc4-43b9-97a7-54400c0015d3 1073741824" returned: 0 in 0.877s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5d12b178-9fc4-43b9-97a7-54400c0015d3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:11 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5d12b178-9fc4-43b9-97a7-54400c0015d3 Jun 02 16:30:11 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:12 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5d12b178-9fc4-43b9-97a7-54400c0015d3" returned: 0 in 0.574s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:12 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:30:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.727s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:12 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd5f546-5aec-4e6f-a3d1-77521fe12bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d12b178-9fc4-43b9-97a7-54400c0015d3', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:12 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1f2812-e50a-4d33-a434-904ece334691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:12 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Creating offline snapshot 61d30db7-4aac-40ca-97df-a2c64a874aef of volume 6c594979-1de4-4444-aebc-1d7e7e62b9ba {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:30:12 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Volume volume-5d12b178-9fc4-43b9-97a7-54400c0015d3 (5d12b178-9fc4-43b9-97a7-54400c0015d3): created successfully Jun 02 16:30:12 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1f2812-e50a-4d33-a434-904ece334691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:12 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Flow 'volume_create_manager' (c3b7e2f5-f9b6-485e-b3ab-9ff2cb7063dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:12 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e06d61-c9d8-4324-8f85-3e3b45177f3e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:12 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-462c0500-b407-456c-9558-12ced5758ea2 tempest-CreateVolumesFromImageTest-997429841 None] Created volume successfully. Jun 02 16:30:12 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba Jun 02 16:30:12 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "cinder-5d12b178-9fc4-43b9-97a7-54400c0015d3-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-5d12b178-9fc4-43b9-97a7-54400c0015d3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "cinder-quobyte-5d12b178-9fc4-43b9-97a7-54400c0015d3" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-quobyte-5d12b178-9fc4-43b9-97a7-54400c0015d3" acquired by "delete_volume" :: waited 0.019s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:12 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c30d3b-7ecf-4b15-814e-2ec047998f75]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5d12b178-9fc4-43b9-97a7-54400c0015d3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:13 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5d12b178-9fc4-43b9-97a7-54400c0015d3 Jun 02 16:30:13 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:13 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba" returned: 0 in 0.754s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:13 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef 1G Jun 02 16:30:13 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:13 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5d12b178-9fc4-43b9-97a7-54400c0015d3" returned: 0 in 0.777s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5d12b178-9fc4-43b9-97a7-54400c0015d3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:13 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5d12b178-9fc4-43b9-97a7-54400c0015d3 Jun 02 16:30:13 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:13 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef 1G" returned: 0 in 0.790s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:13 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef Jun 02 16:30:13 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:14 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5d12b178-9fc4-43b9-97a7-54400c0015d3" returned: 0 in 0.615s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-quobyte-5d12b178-9fc4-43b9-97a7-54400c0015d3" released by "delete_volume" :: held 1.441s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:14 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] Created reservations ['fd9a5b5b-e92d-4353-ad10-db852019b807', '263bdfa1-0254-4d8c-a5c8-c4fed0f41d2b', '9aa856ff-f1b9-4043-95da-3a1cedbe39e4', 'df87b784-772d-488f-8aff-a27ae5e9e7d2'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:30:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:14 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:14 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:30:14 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:14 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef" returned: 0 in 0.691s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:14 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef is being set with open permissions: ugo+rw Jun 02 16:30:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:14 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef Jun 02 16:30:14 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "cinder-94abb97c-38cb-4f8a-963f-241a5286e5a9-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:15 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.626s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:15 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:30:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-94abb97c-38cb-4f8a-963f-241a5286e5a9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:15 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] Deleted volume successfully. Jun 02 16:30:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-0919457d-ea0d-473b-902e-b9b2fc0e718a tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-5d12b178-9fc4-43b9-97a7-54400c0015d3-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "cinder-quobyte-94abb97c-38cb-4f8a-963f-241a5286e5a9" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-quobyte-94abb97c-38cb-4f8a-963f-241a5286e5a9" acquired by "delete_volume" :: waited 0.019s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:15 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[187819f7-3932-4632-8528-1bc17d70b77d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-94abb97c-38cb-4f8a-963f-241a5286e5a9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:15 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef" returned: 0 in 0.668s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:15 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.info Jun 02 16:30:15 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:15 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-94abb97c-38cb-4f8a-963f-241a5286e5a9 Jun 02 16:30:15 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:15 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.info" returned: 0 in 0.594s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:15 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.info is being set with open permissions: ugo+rw Jun 02 16:30:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:15 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.info Jun 02 16:30:15 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:16 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-94abb97c-38cb-4f8a-963f-241a5286e5a9" returned: 0 in 0.808s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-94abb97c-38cb-4f8a-963f-241a5286e5a9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:16 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-94abb97c-38cb-4f8a-963f-241a5286e5a9 Jun 02 16:30:16 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:16 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.info" returned: 0 in 0.658s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.274s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.967s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-360853275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716646e2-26e7-463e-8699-40217ae66fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32440b66ba3421a902036377e22dfc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:07Z,use_quota=True,user_id='a2b1a816be75456486568deb2be2778d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Creating volume 716646e2-26e7-463e-8699-40217ae66fe9 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:16 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:16 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9 1073741824 Jun 02 16:30:16 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:16 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-544c35b4-06bd-4290-bb6b-b701611a5533 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Create snapshot completed successfully Jun 02 16:30:16 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-94abb97c-38cb-4f8a-963f-241a5286e5a9" returned: 0 in 0.655s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-quobyte-94abb97c-38cb-4f8a-963f-241a5286e5a9" released by "delete_volume" :: held 1.515s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] Created reservations ['20ddd7af-5ebb-41bd-bcb7-c659c8437f92', 'af2021ec-419c-4e16-a7aa-106a3c821841', 'ec35584b-33d6-4092-8fd9-9996b77947d1', '2e38aff1-c6f6-40f7-8283-5f46b888126a'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:16 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:30:16 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "cinder-2c1a9ff7-be77-4b80-b315-4b317b742ede-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-2c1a9ff7-be77-4b80-b315-4b317b742ede-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "cinder-quobyte-2c1a9ff7-be77-4b80-b315-4b317b742ede" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-quobyte-2c1a9ff7-be77-4b80-b315-4b317b742ede" acquired by "delete_volume" :: waited 0.016s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fc2d77-1e4f-4c78-8d58-0ffd908c6597]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c1a9ff7-be77-4b80-b315-4b317b742ede {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:17 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.750s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:30:17 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] Deleted volume successfully. Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Flow 'volume_create_manager' (49a99b1b-8863-4e40-a28a-6855b512321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e3a2a0-522d-4013-95b2-3a008a830e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:17 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9 1073741824" returned: 0 in 1.078s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e3a2a0-522d-4013-95b2-3a008a830e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1373938601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f36c73e06734cc89a6dc6868a3370f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:18Z,use_quota=True,user_id='18d94968176c4ff983f96332629b98fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ccd359a-0d38-4b64-8b26-e29ae737837d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ccd359a-0d38-4b64-8b26-e29ae737837d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d92bc3-1ba4-42a6-91d3-c8b9fdd3d6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d92bc3-1ba4-42a6-91d3-c8b9fdd3d6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80', 'volume_name': 'volume-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb63bfb-1d5f-412b-a881-eff0f226259b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb63bfb-1d5f-412b-a881-eff0f226259b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae75edcd-0444-4dea-a977-a179f062dd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:17 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume 8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80', 'volume_size': 1} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:17 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c1a9ff7-be77-4b80-b315-4b317b742ede Jun 02 16:30:17 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-54e4b2aa-2ef3-4394-a6b5-dcc5bb52c6e7 tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-94abb97c-38cb-4f8a-963f-241a5286e5a9-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:17 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9 Jun 02 16:30:17 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:17 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Flow 'volume_create_manager' (8ed8493f-c368-450f-af00-6760e7b0400e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b921174-0aab-476a-a50e-06ddc63d27b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b921174-0aab-476a-a50e-06ddc63d27b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-673571882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a5ae1d-f03c-4069-a3a6-53ac17d5e04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f36c73e06734cc89a6dc6868a3370f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:18Z,use_quota=True,user_id='18d94968176c4ff983f96332629b98fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed561085-2698-4fa4-8d99-78f99d353d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed561085-2698-4fa4-8d99-78f99d353d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95b52f0-16d8-4d5f-8731-75964481b09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95b52f0-16d8-4d5f-8731-75964481b09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a5ae1d-f03c-4069-a3a6-53ac17d5e04d', 'volume_name': 'volume-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c0befa-3691-44e9-b523-703bfd38adf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c0befa-3691-44e9-b523-703bfd38adf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef15760-1ec6-4500-bdf4-8886e3fb8e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:18 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume 82a5ae1d-f03c-4069-a3a6-53ac17d5e04d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d', 'volume_size': 1} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Flow 'volume_create_manager' (38c1afb9-8be3-4355-af3e-331f715cb0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477edeba-84c6-4bd1-9b69-e26e68630c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477edeba-84c6-4bd1-9b69-e26e68630c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1927680404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e93782-be5a-4226-936b-f5a7ae0babf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f36c73e06734cc89a6dc6868a3370f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:18Z,use_quota=True,user_id='18d94968176c4ff983f96332629b98fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8eb50c-b7f1-4e16-9a3f-c639a3eea916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8eb50c-b7f1-4e16-9a3f-c639a3eea916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3416461-6aa9-465c-9098-290805f7640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3416461-6aa9-465c-9098-290805f7640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7e93782-be5a-4226-936b-f5a7ae0babf1', 'volume_name': 'volume-e7e93782-be5a-4226-936b-f5a7ae0babf1', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ccfb2a-de67-4cd8-8394-a9bda43199b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ccfb2a-de67-4cd8-8394-a9bda43199b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80002074-6c9d-41e3-a393-3285f550dd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:18 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume e7e93782-be5a-4226-936b-f5a7ae0babf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7e93782-be5a-4226-936b-f5a7ae0babf1', 'volume_size': 1} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:18 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9" returned: 0 in 0.713s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.892s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059370b3-6eed-4736-8020-904bc0d0cbe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cface15d5014801bbec9461209c9317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:05Z,use_quota=True,user_id='22e6c3b0df74435db2a65f6bfaaa727f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d06d08a4-b16a-4707-bb6a-3243a2362b57),volume_type_id=d06d08a4-b16a-4707-bb6a-3243a2362b57)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Creating volume 059370b3-6eed-4736-8020-904bc0d0cbe7 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:18 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:18 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 1073741824 Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47184f08-18d5-4a07-9598-b040dc891b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-716646e2-26e7-463e-8699-40217ae66fe9', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:18 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8517bb0c-9076-41d6-9dfb-c11d597b385d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:18 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Volume volume-716646e2-26e7-463e-8699-40217ae66fe9 (716646e2-26e7-463e-8699-40217ae66fe9): created successfully Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8517bb0c-9076-41d6-9dfb-c11d597b385d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Flow 'volume_create_manager' (b1bef9c7-8eba-4030-9ae1-5272b3bd2a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:18 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-610da4d5-31a8-4a2d-8072-28d6c0080660 tempest-CinderUnicodeTest-2129592764 None] Created volume successfully. Jun 02 16:30:18 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c1a9ff7-be77-4b80-b315-4b317b742ede" returned: 0 in 1.168s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c1a9ff7-be77-4b80-b315-4b317b742ede {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:18 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c1a9ff7-be77-4b80-b315-4b317b742ede Jun 02 16:30:18 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Flow 'volume_create_manager' (d5d68627-96ec-4b2f-9f10-94aac138773c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e69f307-81f5-460e-8339-98d0d556e53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e69f307-81f5-460e-8339-98d0d556e53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1881233052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a40983bf-00a0-47be-acf2-f17e1bf842a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f36c73e06734cc89a6dc6868a3370f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:19Z,use_quota=True,user_id='18d94968176c4ff983f96332629b98fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f9ff0a-3c25-4770-b6a9-5086c4916965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f9ff0a-3c25-4770-b6a9-5086c4916965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83db184-6719-4531-ac55-54c9a71c7e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83db184-6719-4531-ac55-54c9a71c7e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a40983bf-00a0-47be-acf2-f17e1bf842a4', 'volume_name': 'volume-a40983bf-00a0-47be-acf2-f17e1bf842a4', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f208a3-93ee-4e61-9573-107ad999cb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f208a3-93ee-4e61-9573-107ad999cb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c4b53e-4e49-4d29-8a31-fb0baa0c6d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:18 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume a40983bf-00a0-47be-acf2-f17e1bf842a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a40983bf-00a0-47be-acf2-f17e1bf842a4', 'volume_size': 1} Jun 02 16:30:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Flow 'volume_create_manager' (77fac47a-0549-4774-9126-cc19ada94e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b75d5e-04e6-4999-904f-68716410159a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b75d5e-04e6-4999-904f-68716410159a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1669072630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62da6f76-c753-4bf2-bfbd-e28fa5126b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f36c73e06734cc89a6dc6868a3370f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:19Z,use_quota=True,user_id='18d94968176c4ff983f96332629b98fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (646e54fa-9a47-4c71-a9fe-5385e8d7831c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (646e54fa-9a47-4c71-a9fe-5385e8d7831c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97032e15-b57b-4d39-b6cb-1ff22898731f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97032e15-b57b-4d39-b6cb-1ff22898731f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62da6f76-c753-4bf2-bfbd-e28fa5126b20', 'volume_name': 'volume-62da6f76-c753-4bf2-bfbd-e28fa5126b20', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f288c4f-f534-4ef4-953b-2986713c9a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f288c4f-f534-4ef4-953b-2986713c9a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edada3d8-c506-41a7-841d-cdcdeb8e8daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:19 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume 62da6f76-c753-4bf2-bfbd-e28fa5126b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62da6f76-c753-4bf2-bfbd-e28fa5126b20', 'volume_size': 1} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:19 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2c1a9ff7-be77-4b80-b315-4b317b742ede" returned: 0 in 0.761s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-quobyte-2c1a9ff7-be77-4b80-b315-4b317b742ede" released by "delete_volume" :: held 1.995s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] Created reservations ['a536b161-29f7-4201-aedc-a1d3126cec3a', 'b914a074-7b24-437e-acf3-4c5141eb72b1', '696c5a59-dc31-4199-bff6-6ca4802f7ecf', '070a1015-8617-43c8-b57b-edeaae053627'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:30:19 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 1073741824" returned: 0 in 1.122s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:19 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:30:19 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "cinder-d27fee05-1b6b-441a-a6c1-9881b050dd44-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:19 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 Jun 02 16:30:19 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-d27fee05-1b6b-441a-a6c1-9881b050dd44-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "cinder-quobyte-d27fee05-1b6b-441a-a6c1-9881b050dd44" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-quobyte-d27fee05-1b6b-441a-a6c1-9881b050dd44" acquired by "delete_volume" :: waited 0.016s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[86adc6de-1660-4fae-a0cd-5b6abc588a24]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d27fee05-1b6b-441a-a6c1-9881b050dd44 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:19 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d27fee05-1b6b-441a-a6c1-9881b050dd44 Jun 02 16:30:19 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:20 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.738s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:30:20 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] Deleted volume successfully. Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-3b78fdea-6c6c-4704-904e-5eb5077aabcc tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-2c1a9ff7-be77-4b80-b315-4b317b742ede-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:20 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7" returned: 0 in 0.854s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.843s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1373938601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f36c73e06734cc89a6dc6868a3370f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:18Z,use_quota=True,user_id='18d94968176c4ff983f96332629b98fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Creating volume 8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:20 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Attempting download of 92a7d3fa-39fc-4d5e-9714-aeec345adf3a ((None, [{'url': 'file:///opt/stack/data/glance/images/92a7d3fa-39fc-4d5e-9714-aeec345adf3a', 'metadata': {}}])) to volume 059370b3-6eed-4736-8020-904bc0d0cbe7. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 16:30:20 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80 1073741824 Jun 02 16:30:20 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a62bd00-3446-4fbe-a0ea-0b3527b29e05]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92a7d3fa-39fc-4d5e-9714-aeec345adf3a_w64o4j7a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:20 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:20 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92a7d3fa-39fc-4d5e-9714-aeec345adf3a_w64o4j7a Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d27fee05-1b6b-441a-a6c1-9881b050dd44" returned: 0 in 0.941s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d27fee05-1b6b-441a-a6c1-9881b050dd44 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:20 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:20 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d27fee05-1b6b-441a-a6c1-9881b050dd44 Jun 02 16:30:20 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:21 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80 1073741824" returned: 0 in 0.853s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:21 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-d27fee05-1b6b-441a-a6c1-9881b050dd44" returned: 0 in 0.648s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:21 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92a7d3fa-39fc-4d5e-9714-aeec345adf3a_w64o4j7a" returned: 0 in 0.787s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92a7d3fa-39fc-4d5e-9714-aeec345adf3a_w64o4j7a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:21 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-quobyte-d27fee05-1b6b-441a-a6c1-9881b050dd44" released by "delete_volume" :: held 1.657s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:21 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80 Jun 02 16:30:21 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:21 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] Created reservations ['451ea088-6917-407e-afc3-746da86a996e', 'fa917779-bfd2-47ac-9349-79e6fa6a5232', '5f39f120-dc7d-433c-878b-e692093d33fe', 'a1c98d8f-81cb-4cb7-b7d8-087a7562f4b0'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:30:21 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92a7d3fa-39fc-4d5e-9714-aeec345adf3a_w64o4j7a Jun 02 16:30:21 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:21 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:21 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:30:21 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "cinder-e81d9e20-18f0-46b2-8a21-3057dea3abd3-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-e81d9e20-18f0-46b2-8a21-3057dea3abd3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "cinder-quobyte-e81d9e20-18f0-46b2-8a21-3057dea3abd3" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-quobyte-e81d9e20-18f0-46b2-8a21-3057dea3abd3" acquired by "delete_volume" :: waited 0.025s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b41f7e-906d-4089-8fed-21fe569f0c4b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e81d9e20-18f0-46b2-8a21-3057dea3abd3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:22 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92a7d3fa-39fc-4d5e-9714-aeec345adf3a_w64o4j7a" returned: 1 in 0.774s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92a7d3fa-39fc-4d5e-9714-aeec345adf3a_w64o4j7a' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:30:22 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80" returned: 0 in 0.735s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95643d2-56cd-46e2-bf1c-4d5a6a0f08b8]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.172s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-673571882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a5ae1d-f03c-4069-a3a6-53ac17d5e04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f36c73e06734cc89a6dc6868a3370f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:18Z,use_quota=True,user_id='18d94968176c4ff983f96332629b98fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Creating volume 82a5ae1d-f03c-4069-a3a6-53ac17d5e04d {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:22 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:22 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e81d9e20-18f0-46b2-8a21-3057dea3abd3 Jun 02 16:30:22 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:22 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d 1073741824 Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae75edcd-0444-4dea-a977-a179f062dd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:22 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b673bcd-23ec-4e10-a09d-b9c632009b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:22 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume volume-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80 (8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80): created successfully Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b673bcd-23ec-4e10-a09d-b9c632009b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:22 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Flow 'volume_create_manager' (49a99b1b-8863-4e40-a28a-6855b512321a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.766s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:30:22 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] Deleted volume successfully. Jun 02 16:30:22 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-29765a66-5281-452e-afd9-1baa270776ad tempest-CreateVolumesFromSnapshotTest-1613906066 None] Created volume successfully. Jun 02 16:30:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-be26a63f-1e9f-4f91-9452-615e354a18c5 tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-d27fee05-1b6b-441a-a6c1-9881b050dd44-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:22 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD Jun 02 16:30:22 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:23 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e81d9e20-18f0-46b2-8a21-3057dea3abd3" returned: 0 in 0.823s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e81d9e20-18f0-46b2-8a21-3057dea3abd3 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:23 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e81d9e20-18f0-46b2-8a21-3057dea3abd3 Jun 02 16:30:23 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:23 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD" returned: 0 in 0.821s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:23 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d 1073741824" returned: 0 in 0.918s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:23 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD Jun 02 16:30:23 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:23 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d Jun 02 16:30:23 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:23 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e81d9e20-18f0-46b2-8a21-3057dea3abd3" returned: 0 in 0.663s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-quobyte-e81d9e20-18f0-46b2-8a21-3057dea3abd3" released by "delete_volume" :: held 1.569s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] Created reservations ['40493f59-3c95-4d77-a3ad-40fcf70b4e71', '150730cb-374f-4cda-bd51-f242c6186128', '8ab18228-34d5-40a7-900e-74022afb0c74', '40aad75f-553d-4120-81b7-f9a952f95e5b'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD" returned: 1 in 0.794s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:30:23 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] 92a7d3fa-39fc-4d5e-9714-aeec345adf3a was raw, converting to raw {{(pid=86488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 16:30:23 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d" returned: 0 in 0.703s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:23 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.492s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1927680404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e93782-be5a-4226-936b-f5a7ae0babf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f36c73e06734cc89a6dc6868a3370f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:18Z,use_quota=True,user_id='18d94968176c4ff983f96332629b98fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:30:23 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Creating volume e7e93782-be5a-4226-936b-f5a7ae0babf1 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:23 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:24 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e7e93782-be5a-4226-936b-f5a7ae0babf1 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:23 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 Jun 02 16:30:23 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:24 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e7e93782-be5a-4226-936b-f5a7ae0babf1 1073741824 Jun 02 16:30:24 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef15760-1ec6-4500-bdf4-8886e3fb8e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df85d659-d1b4-4b9b-b0e2-a0c85612c4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:24 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume volume-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d (82a5ae1d-f03c-4069-a3a6-53ac17d5e04d): created successfully Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df85d659-d1b4-4b9b-b0e2-a0c85612c4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Flow 'volume_create_manager' (8ed8493f-c368-450f-af00-6760e7b0400e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:24 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9aa55e0c-fe44-4c14-9d91-442ad7f0a46e tempest-CreateVolumesFromSnapshotTest-1613906066 None] Created volume successfully. Jun 02 16:30:24 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.703s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:30:24 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] Deleted volume successfully. Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2af779a7-c039-4447-842b-554539c12daf tempest-CreateVolumesFromImageTest-997429841 None] Lock "cinder-e81d9e20-18f0-46b2-8a21-3057dea3abd3-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:24 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7" returned: 0 in 0.969s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_92a7d3fa-39fc-4d5e-9714-aeec345adf3a__wnijpafdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:30:24 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Converted 0.00 MB image at 0.00 MB/s Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:24 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e7e93782-be5a-4226-936b-f5a7ae0babf1 1073741824" returned: 0 in 0.935s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:24 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 1G Jun 02 16:30:24 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e7e93782-be5a-4226-936b-f5a7ae0babf1 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:24 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e7e93782-be5a-4226-936b-f5a7ae0babf1 Jun 02 16:30:24 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:25 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 1G" returned: 0 in 0.740s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:25 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e7e93782-be5a-4226-936b-f5a7ae0babf1" returned: 0 in 0.723s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.762s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1881233052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a40983bf-00a0-47be-acf2-f17e1bf842a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f36c73e06734cc89a6dc6868a3370f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:19Z,use_quota=True,user_id='18d94968176c4ff983f96332629b98fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Creating volume a40983bf-00a0-47be-acf2-f17e1bf842a4 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:25 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a40983bf-00a0-47be-acf2-f17e1bf842a4 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4e9d38-ab0a-4c64-af2a-6702a9bec0a7]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80002074-6c9d-41e3-a393-3285f550dd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7e93782-be5a-4226-936b-f5a7ae0babf1', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:25 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a40983bf-00a0-47be-acf2-f17e1bf842a4 1073741824 Jun 02 16:30:25 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd3608d-c6b2-4b57-a9f3-9e9b86607141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:25 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume volume-e7e93782-be5a-4226-936b-f5a7ae0babf1 (e7e93782-be5a-4226-936b-f5a7ae0babf1): created successfully Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd3608d-c6b2-4b57-a9f3-9e9b86607141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Flow 'volume_create_manager' (38c1afb9-8be3-4355-af3e-331f715cb0cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:25 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-4b10adb9-3b3b-4833-a76c-8c2654a539bb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Created volume successfully. Jun 02 16:30:25 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 Jun 02 16:30:25 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:26 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7" returned: 0 in 0.869s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:26 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a40983bf-00a0-47be-acf2-f17e1bf842a4 1073741824" returned: 0 in 0.938s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a40983bf-00a0-47be-acf2-f17e1bf842a4 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:26 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 Jun 02 16:30:26 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:26 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a40983bf-00a0-47be-acf2-f17e1bf842a4 Jun 02 16:30:26 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:27 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7" returned: 1 in 0.818s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Downloaded image 92a7d3fa-39fc-4d5e-9714-aeec345adf3a ((None, [{'url': 'file:///opt/stack/data/glance/images/92a7d3fa-39fc-4d5e-9714-aeec345adf3a', 'metadata': {}}])) to volume 059370b3-6eed-4736-8020-904bc0d0cbe7 successfully. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Temporary image 92a7d3fa-39fc-4d5e-9714-aeec345adf3a for user 22e6c3b0df74435db2a65f6bfaaa727f is deleted. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Marking volume 059370b3-6eed-4736-8020-904bc0d0cbe7 as bootable. {{(pid=86488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 16:30:27 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a40983bf-00a0-47be-acf2-f17e1bf842a4" returned: 0 in 0.726s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1669072630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62da6f76-c753-4bf2-bfbd-e28fa5126b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f36c73e06734cc89a6dc6868a3370f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:19Z,use_quota=True,user_id='18d94968176c4ff983f96332629b98fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Creating volume 62da6f76-c753-4bf2-bfbd-e28fa5126b20 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:27 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62da6f76-c753-4bf2-bfbd-e28fa5126b20 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Copying metadata from image 92a7d3fa-39fc-4d5e-9714-aeec345adf3a to 059370b3-6eed-4736-8020-904bc0d0cbe7. {{(pid=86488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Creating volume glance metadata for volume 059370b3-6eed-4736-8020-904bc0d0cbe7 backed by image 92a7d3fa-39fc-4d5e-9714-aeec345adf3a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '92a7d3fa-39fc-4d5e-9714-aeec345adf3a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0a649497220ee8ff46140e5b851245ec', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c4b53e-4e49-4d29-8a31-fb0baa0c6d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a40983bf-00a0-47be-acf2-f17e1bf842a4', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:27 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62da6f76-c753-4bf2-bfbd-e28fa5126b20 1073741824 Jun 02 16:30:27 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7515020c-7785-42fa-a6e6-52e686421ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:27 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume volume-a40983bf-00a0-47be-acf2-f17e1bf842a4 (a40983bf-00a0-47be-acf2-f17e1bf842a4): created successfully Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7515020c-7785-42fa-a6e6-52e686421ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Flow 'volume_create_manager' (d5d68627-96ec-4b2f-9f10-94aac138773c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:27 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-8c9ca99c-c604-4baf-a63f-96a9a4861a12 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Created volume successfully. Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7555c406-2223-47ca-9150-0e8479ff3ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-059370b3-6eed-4736-8020-904bc0d0cbe7', 'volume_size': 1, 'image_id': '92a7d3fa-39fc-4d5e-9714-aeec345adf3a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92a7d3fa-39fc-4d5e-9714-aeec345adf3a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a649497220ee8ff46140e5b851245ec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8cface15d5014801bbec9461209c9317', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8838952c1e64f8eee06713c4cfebaeeb37c8cb7884bbd2b360b9cb890f8bcf0315ef9c42f87c9115b44fbc21c9e886475950c5606506f672ff4ca6a95855c7ff', 'id': '92a7d3fa-39fc-4d5e-9714-aeec345adf3a', 'created_at': datetime.datetime(2026, 6, 2, 14, 30, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 30, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92a7d3fa-39fc-4d5e-9714-aeec345adf3a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488b1716-67cd-4a3f-b28e-c2e5dbd57032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:27 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Volume volume-059370b3-6eed-4736-8020-904bc0d0cbe7 (059370b3-6eed-4736-8020-904bc0d0cbe7): created successfully Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488b1716-67cd-4a3f-b28e-c2e5dbd57032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:27 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Flow 'volume_create_manager' (f9dd29f6-85d3-462f-bbe3-a1fecdec96b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:27 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-6f648fa4-d02f-4630-b718-04b8035dfc60 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Created volume successfully. Jun 02 16:30:28 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62da6f76-c753-4bf2-bfbd-e28fa5126b20 1073741824" returned: 0 in 0.954s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62da6f76-c753-4bf2-bfbd-e28fa5126b20 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:28 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62da6f76-c753-4bf2-bfbd-e28fa5126b20 Jun 02 16:30:28 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Acquiring lock "cinder-059370b3-6eed-4736-8020-904bc0d0cbe7-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Lock "cinder-059370b3-6eed-4736-8020-904bc0d0cbe7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Acquiring lock "cinder-quobyte-059370b3-6eed-4736-8020-904bc0d0cbe7" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:28 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Lock "cinder-quobyte-059370b3-6eed-4736-8020-904bc0d0cbe7" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:28 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c672207-cafc-4240-aff6-f246f8e5511d]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:28 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:29 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62da6f76-c753-4bf2-bfbd-e28fa5126b20" returned: 0 in 0.647s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.326s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:29 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 Jun 02 16:30:29 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edada3d8-c506-41a7-841d-cdcdeb8e8daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62da6f76-c753-4bf2-bfbd-e28fa5126b20', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93d97572-ef7b-4067-b9d5-9ff771d7d105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] Creating offline snapshot deac3aa8-5a32-45c7-a13c-4ce280cc32f2 of volume 716646e2-26e7-463e-8699-40217ae66fe9 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:30:29 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Volume volume-62da6f76-c753-4bf2-bfbd-e28fa5126b20 (62da6f76-c753-4bf2-bfbd-e28fa5126b20): created successfully Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93d97572-ef7b-4067-b9d5-9ff771d7d105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Flow 'volume_create_manager' (77fac47a-0549-4774-9126-cc19ada94e29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[63631994-5d96-436d-b83d-84d2f762a076]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:29 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-096c9382-065d-4ffd-828d-63bf6ba72b1f tempest-CreateVolumesFromSnapshotTest-1613906066 None] Created volume successfully. Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "cinder-62da6f76-c753-4bf2-bfbd-e28fa5126b20-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:29 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9 Jun 02 16:30:29 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-62da6f76-c753-4bf2-bfbd-e28fa5126b20-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "cinder-quobyte-62da6f76-c753-4bf2-bfbd-e28fa5126b20" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-quobyte-62da6f76-c753-4bf2-bfbd-e28fa5126b20" acquired by "delete_volume" :: waited 0.022s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[846c6fd4-cb5b-4d22-9355-f464e5829570]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62da6f76-c753-4bf2-bfbd-e28fa5126b20 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:29 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62da6f76-c753-4bf2-bfbd-e28fa5126b20 Jun 02 16:30:29 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:29 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7" returned: 0 in 0.826s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:29 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:29 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 Jun 02 16:30:29 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:30 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9" returned: 0 in 1.027s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:30 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2 1G Jun 02 16:30:30 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Flow 'volume_create_manager' (bf3ec26e-5d12-4e5e-b0bc-19394567667a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c30781ac-ca98-4e9a-b3e5-5b69c231d0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c30781ac-ca98-4e9a-b3e5-5b69c231d0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ca9209-c872-4273-a2fc-808389a2d558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d1b01910ee4983b2b65ab9333e3fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:30Z,use_quota=True,user_id='2c1c02744c7042009c1500d7889a579d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b73cef6-1c69-4113-8308-22ffd4faa873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b73cef6-1c69-4113-8308-22ffd4faa873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d57e39-8405-4834-a5d6-5fe49aaa5ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG cinder.image.glance [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Creating Keystone auth plugin from conf {{(pid=86488) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 16:30:30 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62da6f76-c753-4bf2-bfbd-e28fa5126b20" returned: 0 in 1.066s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62da6f76-c753-4bf2-bfbd-e28fa5126b20 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:30 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62da6f76-c753-4bf2-bfbd-e28fa5126b20 Jun 02 16:30:30 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:30 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d57e39-8405-4834-a5d6-5fe49aaa5ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3ca9209-c872-4273-a2fc-808389a2d558', 'volume_name': 'volume-b3ca9209-c872-4273-a2fc-808389a2d558', 'volume_size': 1, 'image_id': 'd44d402d-eb0d-44c1-a6e4-1b6002672616', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d44d402d-eb0d-44c1-a6e4-1b6002672616', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '50c17f86d803ee94799a678f0a0c0769', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '70d1b01910ee4983b2b65ab9333e3fa7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db647e339495769c4e442d506a35874351fc2bbe169b40302ee3c2f792b84c4f35dec28ba19c23964a3f3feba5d6ff48b3f74b7d92c3d8292f274c24f6cf3d5d', 'id': 'd44d402d-eb0d-44c1-a6e4-1b6002672616', 'created_at': datetime.datetime(2026, 6, 2, 14, 30, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 30, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d44d402d-eb0d-44c1-a6e4-1b6002672616/file', 'properties': {}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d137c4c-218e-48c5-b34a-f6ace6b9d241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d137c4c-218e-48c5-b34a-f6ace6b9d241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84db5107-9d26-474f-b6a6-966694f21256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:30 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Volume b3ca9209-c872-4273-a2fc-808389a2d558: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3ca9209-c872-4273-a2fc-808389a2d558', 'volume_size': 1, 'image_id': 'd44d402d-eb0d-44c1-a6e4-1b6002672616', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d44d402d-eb0d-44c1-a6e4-1b6002672616', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '50c17f86d803ee94799a678f0a0c0769', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '70d1b01910ee4983b2b65ab9333e3fa7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db647e339495769c4e442d506a35874351fc2bbe169b40302ee3c2f792b84c4f35dec28ba19c23964a3f3feba5d6ff48b3f74b7d92c3d8292f274c24f6cf3d5d', 'id': 'd44d402d-eb0d-44c1-a6e4-1b6002672616', 'created_at': datetime.datetime(2026, 6, 2, 14, 30, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 30, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d44d402d-eb0d-44c1-a6e4-1b6002672616/file', 'properties': {}}, 'image_service': } Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Trying to clone b3ca9209-c872-4273-a2fc-808389a2d558 from image d44d402d-eb0d-44c1-a6e4-1b6002672616 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d44d402d-eb0d-44c1-a6e4-1b6002672616', 'metadata': {}}]). {{(pid=86488) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7" returned: 1 in 1.035s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:30 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7 Jun 02 16:30:30 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:30 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 16:30:30 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Image download 0.00 MB at 0.00 MB/s Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9840fd85-3e33-4889-978f-446329eff1eb]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:31 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD Jun 02 16:30:31 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:31 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2 1G" returned: 0 in 1.122s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-716646e2-26e7-463e-8699-40217ae66fe9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:31 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-716646e2-26e7-463e-8699-40217ae66fe9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2 Jun 02 16:30:31 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:31 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-62da6f76-c753-4bf2-bfbd-e28fa5126b20" returned: 0 in 0.883s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-quobyte-62da6f76-c753-4bf2-bfbd-e28fa5126b20" released by "delete_volume" :: held 2.006s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Created reservations ['b7a8b08a-1f20-4ea1-94dd-c234493cae01', '681209fb-f50f-486a-be73-1a05de59701a', '05469928-94fd-4027-88d3-a68f51733c99', '73197179-e640-4f40-98af-a899db3a240d'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:30:31 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-059370b3-6eed-4736-8020-904bc0d0cbe7" returned: 0 in 0.814s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Lock "cinder-quobyte-059370b3-6eed-4736-8020-904bc0d0cbe7" released by "delete_volume" :: held 2.752s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:31 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:30:31 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "cinder-a40983bf-00a0-47be-acf2-f17e1bf842a4-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-a40983bf-00a0-47be-acf2-f17e1bf842a4-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Created reservations ['6e1a0ad4-ceef-4ed7-8c6e-500ec52e4f19', '5a38b80e-a12e-465f-a4f1-a6269ba75422', '951c144b-73d7-4876-9391-4a97b75cdf56', '2a918205-4c44-4c99-9146-d557155ffbc8'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "cinder-quobyte-a40983bf-00a0-47be-acf2-f17e1bf842a4" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:31 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD" returned: 0 in 0.918s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-quobyte-a40983bf-00a0-47be-acf2-f17e1bf842a4" acquired by "delete_volume" :: waited 0.052s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec5388d-1363-444c-a8af-855abdfa770d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a40983bf-00a0-47be-acf2-f17e1bf842a4 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:32 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:32 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:30:32 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:32 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD Jun 02 16:30:32 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:32 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-716646e2-26e7-463e-8699-40217ae66fe9 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2" returned: 0 in 0.847s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:32 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2 is being set with open permissions: ugo+rw Jun 02 16:30:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:32 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a40983bf-00a0-47be-acf2-f17e1bf842a4 Jun 02 16:30:32 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:32 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2 Jun 02 16:30:32 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:32 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD" returned: 1 in 0.919s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:30:32 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Temporary image d44d402d-eb0d-44c1-a6e4-1b6002672616 is fetched for user 2c1c02744c7042009c1500d7889a579d. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 16:30:32 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.239s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:32 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:30:32 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Deleted volume successfully. Jun 02 16:30:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-36758191-a11b-48f3-a780-96a3653ef917 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-62da6f76-c753-4bf2-bfbd-e28fa5126b20-delete_volume" released by "delete_volume" :: held 3.613s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:33 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[786cc345-f91c-4906-84fa-6d3f98b0d25b]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:33 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2" returned: 0 in 0.937s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:33 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:33 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.info Jun 02 16:30:33 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.197s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:33 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:30:33 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Deleted volume successfully. Jun 02 16:30:33 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a40983bf-00a0-47be-acf2-f17e1bf842a4" returned: 0 in 1.285s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a40983bf-00a0-47be-acf2-f17e1bf842a4 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-246bb7cf-b9ed-4e7c-b3f8-ccac3e7b0753 tempest-VolumeAndVolumeTypeFromImageTest-1615156586 None] Lock "cinder-059370b3-6eed-4736-8020-904bc0d0cbe7-delete_volume" released by "delete_volume" :: held 4.445s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:33 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD Jun 02 16:30:33 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:33 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a40983bf-00a0-47be-acf2-f17e1bf842a4 Jun 02 16:30:33 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:33 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD" returned: 0 in 0.869s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:33 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.info" returned: 0 in 0.798s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:33 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.info is being set with open permissions: ugo+rw Jun 02 16:30:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:33 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.info Jun 02 16:30:33 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:34 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a40983bf-00a0-47be-acf2-f17e1bf842a4" returned: 0 in 0.793s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-quobyte-a40983bf-00a0-47be-acf2-f17e1bf842a4" released by "delete_volume" :: held 2.138s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:34 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD Jun 02 16:30:34 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Created reservations ['e2933def-51f9-4357-9f7e-467276a206a7', 'a69bd01a-4302-4e60-9738-e102a3f168df', '0b6802f7-d33c-4f67-a554-34cc9915ded8', 'e8c2316b-230e-480d-aa73-c798994bb205'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:34 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:30:34 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:34 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.info" returned: 0 in 0.901s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.802s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:34 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD" returned: 1 in 0.953s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ca9209-c872-4273-a2fc-808389a2d558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d1b01910ee4983b2b65ab9333e3fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:30Z,use_quota=True,user_id='2c1c02744c7042009c1500d7889a579d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Creating volume b3ca9209-c872-4273-a2fc-808389a2d558 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:34 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:30:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:34 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 1073741824 Jun 02 16:30:34 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:34 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-043e812f-e561-4175-aca8-2e7871cb1e8d tempest-CinderUnicodeTest-2129592764 None] Create snapshot completed successfully Jun 02 16:30:35 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.765s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:30:35 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Deleted volume successfully. Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-2ec7902e-b280-43e5-be38-6a8063ad9603 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-a40983bf-00a0-47be-acf2-f17e1bf842a4-delete_volume" released by "delete_volume" :: held 3.302s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "cinder-e7e93782-be5a-4226-936b-f5a7ae0babf1-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-e7e93782-be5a-4226-936b-f5a7ae0babf1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "cinder-quobyte-e7e93782-be5a-4226-936b-f5a7ae0babf1" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-quobyte-e7e93782-be5a-4226-936b-f5a7ae0babf1" acquired by "delete_volume" :: waited 0.024s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[244c1ee2-a66c-4c87-9516-27ce7a661a95]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e7e93782-be5a-4226-936b-f5a7ae0babf1 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:35 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e7e93782-be5a-4226-936b-f5a7ae0babf1 Jun 02 16:30:35 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] Acquiring lock "cinder-deac3aa8-5a32-45c7-a13c-4ce280cc32f2-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] Lock "cinder-deac3aa8-5a32-45c7-a13c-4ce280cc32f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] Acquiring lock "cinder-quobyte-716646e2-26e7-463e-8699-40217ae66fe9" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] Lock "cinder-quobyte-716646e2-26e7-463e-8699-40217ae66fe9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] Acquiring lock "cinder-quobyte-deac3aa8-5a32-45c7-a13c-4ce280cc32f2" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] Lock "cinder-quobyte-deac3aa8-5a32-45c7-a13c-4ce280cc32f2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] Deleting offline snapshot deac3aa8-5a32-45c7-a13c-4ce280cc32f2 of volume 716646e2-26e7-463e-8699-40217ae66fe9 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] snapshot_file for this snap is: volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[f233a1b7-ff6b-462a-a389-4a0591a5c7d5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:35 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2 Jun 02 16:30:35 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:35 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 1073741824" returned: 0 in 1.055s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:36 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 Jun 02 16:30:36 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:36 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e7e93782-be5a-4226-936b-f5a7ae0babf1" returned: 0 in 0.995s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e7e93782-be5a-4226-936b-f5a7ae0babf1 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:36 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e7e93782-be5a-4226-936b-f5a7ae0babf1 Jun 02 16:30:36 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:36 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2" returned: 0 in 0.884s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-716646e2-26e7-463e-8699-40217ae66fe9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:30:36 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1065d6a1-f20c-4f1f-9616-6190c742fa89]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:36 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9 Jun 02 16:30:36 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:36 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558" returned: 0 in 0.781s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:36 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:30:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:36 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Attempting download of d44d402d-eb0d-44c1-a6e4-1b6002672616 ((None, [{'url': 'file:///opt/stack/data/glance/images/d44d402d-eb0d-44c1-a6e4-1b6002672616', 'metadata': {}}])) to volume b3ca9209-c872-4273-a2fc-808389a2d558. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 16:30:36 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3d62ff-89f0-40b7-a0d8-c44d9d7ebce4]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d44d402d-eb0d-44c1-a6e4-1b6002672616_9wtjiy8t {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:37 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d44d402d-eb0d-44c1-a6e4-1b6002672616_9wtjiy8t Jun 02 16:30:37 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:37 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-e7e93782-be5a-4226-936b-f5a7ae0babf1" returned: 0 in 0.731s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-quobyte-e7e93782-be5a-4226-936b-f5a7ae0babf1" released by "delete_volume" :: held 1.796s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Created reservations ['785b24b9-1bc0-48e5-acc2-4c37317917e7', '55d61456-badd-49bf-8db5-ad57384612cf', '35ba006c-0c49-41eb-98e2-dd0146a715f9', '97c044e1-95fd-422a-ac36-aa0d9d75962b'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:37 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:30:37 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:37 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9" returned: 0 in 0.875s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:37 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2 Jun 02 16:30:37 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "cinder-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "cinder-quobyte-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-quobyte-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d" acquired by "delete_volume" :: waited 0.029s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b419c6a-ca45-42e9-abb4-2d6126552314]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:37 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d44d402d-eb0d-44c1-a6e4-1b6002672616_9wtjiy8t" returned: 0 in 0.929s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d44d402d-eb0d-44c1-a6e4-1b6002672616_9wtjiy8t {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:37 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d Jun 02 16:30:37 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:38 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d44d402d-eb0d-44c1-a6e4-1b6002672616_9wtjiy8t Jun 02 16:30:38 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:38 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.923s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:30:38 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Deleted volume successfully. Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Flow 'volume_create_manager' (90147bb8-3797-4774-8519-80d8b7505157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cecb84b4-071e-4248-946e-b43220573401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cecb84b4-071e-4248-946e-b43220573401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-716578043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1697cdd-1500-4a3f-bf57-528f1de8a768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93a05a0076949b3a42ad0b3bb0c4fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:38Z,use_quota=True,user_id='9964db6896eb44a38eb5f3a995776a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c4f6ec-01b4-4b59-bbc5-dc80c00a4bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c4f6ec-01b4-4b59-bbc5-dc80c00a4bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ea1ec8-9fad-451d-9e02-f27389809285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ea1ec8-9fad-451d-9e02-f27389809285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1697cdd-1500-4a3f-bf57-528f1de8a768', 'volume_name': 'volume-a1697cdd-1500-4a3f-bf57-528f1de8a768', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7011827a-8010-4495-af6f-a328099c3f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7011827a-8010-4495-af6f-a328099c3f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca1a33c-db51-4c08-baad-1111b148bafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:38 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Volume a1697cdd-1500-4a3f-bf57-528f1de8a768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1697cdd-1500-4a3f-bf57-528f1de8a768', 'volume_size': 1} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-716578043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1697cdd-1500-4a3f-bf57-528f1de8a768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93a05a0076949b3a42ad0b3bb0c4fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:38Z,use_quota=True,user_id='9964db6896eb44a38eb5f3a995776a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Creating volume a1697cdd-1500-4a3f-bf57-528f1de8a768 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:38 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b6a04f6c-5ba4-4a05-b9e2-6a27f432dda9 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-e7e93782-be5a-4226-936b-f5a7ae0babf1-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:38 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 1073741824 Jun 02 16:30:38 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:38 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2" returned: 0 in 1.109s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:38 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2 Jun 02 16:30:38 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:38 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d" returned: 0 in 1.048s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:38 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d Jun 02 16:30:38 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:38 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d44d402d-eb0d-44c1-a6e4-1b6002672616_9wtjiy8t" returned: 1 in 1.042s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d44d402d-eb0d-44c1-a6e4-1b6002672616_9wtjiy8t' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[de550d98-2bce-471b-b782-49c1029d4e02]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:39 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD Jun 02 16:30:39 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:39 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 1073741824" returned: 0 in 0.926s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:39 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9.deac3aa8-5a32-45c7-a13c-4ce280cc32f2" returned: 0 in 0.814s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:39 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 Jun 02 16:30:39 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] Lock "cinder-quobyte-deac3aa8-5a32-45c7-a13c-4ce280cc32f2" released by "_delete_snapshot" :: held 3.875s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] Lock "cinder-quobyte-716646e2-26e7-463e-8699-40217ae66fe9" released by "delete_snapshot" :: held 3.903s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:39 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d" returned: 0 in 0.714s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-quobyte-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d" released by "delete_volume" :: held 1.829s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] Created reservations ['6a26af3a-fe4f-4a87-b216-fe5bc6786826', '87ab1eae-6820-44d4-bcdc-058e2121037b', '2a67312c-0414-4ca8-8647-2ed6d8f2cb44', '833bed11-af9f-441f-b6d6-1cbab391e45d'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Created reservations ['281b6453-25c2-485a-87a5-1c156065897b', '7200c0c7-237e-4db0-8025-607150985724', 'e6d91a6a-8e95-44cc-94a3-3492e65dcc11', '4ae5c6c1-4d2e-42d6-a9cb-81a28ed16f2c'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:30:39 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] Delete snapshot completed successfully. Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a60735ae-a104-49b9-b5b7-05c3029968dd tempest-CinderUnicodeTest-2129592764 None] Lock "cinder-deac3aa8-5a32-45c7-a13c-4ce280cc32f2-delete_snapshot" released by "delete_snapshot" :: held 4.135s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:39 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD" returned: 0 in 0.827s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:39 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:30:39 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] Acquiring lock "cinder-716646e2-26e7-463e-8699-40217ae66fe9-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "cinder-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:39 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD Jun 02 16:30:39 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] Lock "cinder-716646e2-26e7-463e-8699-40217ae66fe9-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "cinder-quobyte-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] Acquiring lock "cinder-quobyte-716646e2-26e7-463e-8699-40217ae66fe9" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-quobyte-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] Lock "cinder-quobyte-716646e2-26e7-463e-8699-40217ae66fe9" acquired by "delete_volume" :: waited 0.037s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[15de0ccc-d14a-444c-97d9-b0f140d9e0c5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ad4327-6222-4580-9907-aab46e35c01d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:40 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9 Jun 02 16:30:40 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:40 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:40 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80 Jun 02 16:30:40 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768" returned: 0 in 0.968s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca1a33c-db51-4c08-baad-1111b148bafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1697cdd-1500-4a3f-bf57-528f1de8a768', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28888a02-bb4c-4496-a1cc-6ff35650f84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:40 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Volume volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 (a1697cdd-1500-4a3f-bf57-528f1de8a768): created successfully Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28888a02-bb4c-4496-a1cc-6ff35650f84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Flow 'volume_create_manager' (90147bb8-3797-4774-8519-80d8b7505157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:40 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-3751725e-64e4-4a55-8d5f-838c2e7f5e09 tempest-VolumeDependencyTests-1023081523 None] Created volume successfully. Jun 02 16:30:40 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.889s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:30:40 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Deleted volume successfully. Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1959b1b6-13e7-45ad-99fe-668c9777efbb tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-82a5ae1d-f03c-4069-a3a6-53ac17d5e04d-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:40 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD" returned: 1 in 1.008s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] d44d402d-eb0d-44c1-a6e4-1b6002672616 was raw, converting to raw {{(pid=86488) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:40 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 Jun 02 16:30:40 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:40 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80" returned: 0 in 0.893s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:40 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80 Jun 02 16:30:40 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:40 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9" returned: 0 in 0.929s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:41 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9 Jun 02 16:30:41 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:41 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558" returned: 0 in 0.885s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d44d402d-eb0d-44c1-a6e4-1b6002672616_ekfe_i8ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:30:41 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Converted 0.00 MB image at 0.00 MB/s Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:41 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 1G Jun 02 16:30:41 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] Creating offline snapshot ade7106d-0222-42a7-9ec1-e927ab77e309 of volume a1697cdd-1500-4a3f-bf57-528f1de8a768 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f87bef8-b231-4410-addc-592f45091c85]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:41 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-716646e2-26e7-463e-8699-40217ae66fe9" returned: 0 in 0.726s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:41 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80" returned: 0 in 0.801s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] Lock "cinder-quobyte-716646e2-26e7-463e-8699-40217ae66fe9" released by "delete_volume" :: held 1.744s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-quobyte-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80" released by "delete_volume" :: held 1.790s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] Created reservations ['32ac7adc-6e09-4116-a5e3-57e55e2a252a', 'e9bd9d98-1eb6-4ac1-9d19-35edefdb8d4e', '3d36dde6-ee4f-4b76-92fc-74a6cfecaa9f', '05426b2b-50bf-4b50-9de2-1b068addff77'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Created reservations ['87c7d928-c3d6-4768-baf6-dc7ca536542a', '03bd91de-1394-41ad-ac60-e820f52fb104', '98e1d8f7-9cea-455c-8cde-9286024c8c3f', '5d51a5ed-cdb2-4bf1-acaa-5cca7cbc75c5'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:30:41 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 Jun 02 16:30:41 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:41 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:30:41 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:42 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:30:42 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] Acquiring lock "cinder-5fca44d7-a30c-41d5-b802-14d20e00153a-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "cinder-61d30db7-4aac-40ca-97df-a2c64a874aef-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] Lock "cinder-5fca44d7-a30c-41d5-b802-14d20e00153a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-61d30db7-4aac-40ca-97df-a2c64a874aef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "cinder-quobyte-6c594979-1de4-4444-aebc-1d7e7e62b9ba" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-quobyte-6c594979-1de4-4444-aebc-1d7e7e62b9ba" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "cinder-quobyte-61d30db7-4aac-40ca-97df-a2c64a874aef" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] Acquiring lock "cinder-quobyte-5fca44d7-a30c-41d5-b802-14d20e00153a" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-quobyte-61d30db7-4aac-40ca-97df-a2c64a874aef" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Deleting offline snapshot 61d30db7-4aac-40ca-97df-a2c64a874aef of volume 6c594979-1de4-4444-aebc-1d7e7e62b9ba {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] snapshot_file for this snap is: volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] Lock "cinder-quobyte-5fca44d7-a30c-41d5-b802-14d20e00153a" acquired by "delete_volume" :: waited 0.071s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d5ba66-ab73-4618-9733-a35b27177a24]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aaf634-204d-46e1-89d2-62f2e00492ba]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fca44d7-a30c-41d5-b802-14d20e00153a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:42 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 1G" returned: 0 in 1.077s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2751261b-0188-4410-b911-09c42ec21147]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:42 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fca44d7-a30c-41d5-b802-14d20e00153a Jun 02 16:30:42 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:42 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef Jun 02 16:30:42 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:42 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.997s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:30:42 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 Jun 02 16:30:42 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:42 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] Deleted volume successfully. Jun 02 16:30:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8b057086-1424-47e7-b4fb-d3a82cadc968 tempest-CinderUnicodeTest-2129592764 None] Lock "cinder-716646e2-26e7-463e-8699-40217ae66fe9-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:43 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768" returned: 0 in 1.379s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:43 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.130s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:43 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:30:43 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309 1G Jun 02 16:30:43 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:43 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Deleted volume successfully. Jun 02 16:30:43 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-78b47889-5359-470c-92a6-da6218d0e5f7 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-8664ec6d-e53b-4c9c-8698-f8f0b5fdaf80-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:43 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558" returned: 0 in 0.910s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:43 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef" returned: 0 in 1.075s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:43 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:30:43 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5832ece0-d225-4c94-8469-4e702587ca97]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:43 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fca44d7-a30c-41d5-b802-14d20e00153a" returned: 0 in 1.093s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:43 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fca44d7-a30c-41d5-b802-14d20e00153a {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:43 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fca44d7-a30c-41d5-b802-14d20e00153a Jun 02 16:30:43 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:43 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 Jun 02 16:30:43 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:43 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba Jun 02 16:30:43 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:44 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309 1G" returned: 0 in 0.962s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:44 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309 Jun 02 16:30:44 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:44 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558" returned: 1 in 0.796s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Downloaded image d44d402d-eb0d-44c1-a6e4-1b6002672616 ((None, [{'url': 'file:///opt/stack/data/glance/images/d44d402d-eb0d-44c1-a6e4-1b6002672616', 'metadata': {}}])) to volume b3ca9209-c872-4273-a2fc-808389a2d558 successfully. {{(pid=86488) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Temporary image d44d402d-eb0d-44c1-a6e4-1b6002672616 for user 2c1c02744c7042009c1500d7889a579d is deleted. {{(pid=86488) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG cinder.volume.volume_utils [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Marking volume b3ca9209-c872-4273-a2fc-808389a2d558 as bootable. {{(pid=86488) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 16:30:44 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Copying metadata from image d44d402d-eb0d-44c1-a6e4-1b6002672616 to b3ca9209-c872-4273-a2fc-808389a2d558. {{(pid=86488) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Creating volume glance metadata for volume b3ca9209-c872-4273-a2fc-808389a2d558 backed by image d44d402d-eb0d-44c1-a6e4-1b6002672616 with: {'image_id': 'd44d402d-eb0d-44c1-a6e4-1b6002672616', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '50c17f86d803ee94799a678f0a0c0769', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86488) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-5fca44d7-a30c-41d5-b802-14d20e00153a" returned: 0 in 0.738s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] Lock "cinder-quobyte-5fca44d7-a30c-41d5-b802-14d20e00153a" released by "delete_volume" :: held 1.925s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:44 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba" returned: 0 in 0.866s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84db5107-9d26-474f-b6a6-966694f21256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ca9209-c872-4273-a2fc-808389a2d558', 'volume_size': 1, 'image_id': 'd44d402d-eb0d-44c1-a6e4-1b6002672616', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d44d402d-eb0d-44c1-a6e4-1b6002672616', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '50c17f86d803ee94799a678f0a0c0769', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '70d1b01910ee4983b2b65ab9333e3fa7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db647e339495769c4e442d506a35874351fc2bbe169b40302ee3c2f792b84c4f35dec28ba19c23964a3f3feba5d6ff48b3f74b7d92c3d8292f274c24f6cf3d5d', 'id': 'd44d402d-eb0d-44c1-a6e4-1b6002672616', 'created_at': datetime.datetime(2026, 6, 2, 14, 30, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 14, 30, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d44d402d-eb0d-44c1-a6e4-1b6002672616/file', 'properties': {}}, 'image_service': }' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5340bfe3-46ae-4e94-9543-a69ba171d6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:44 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef Jun 02 16:30:44 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] Created reservations ['5707c5e6-dd20-4fe4-96e6-24575999562d', '385666e1-06a1-4aed-8e22-7588227a8010', 'a1e021e5-cf2c-426d-a235-67a9d2201ae6', '78d40dcd-e2f7-46a9-9594-d80d022eb6cc'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:30:44 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Volume volume-b3ca9209-c872-4273-a2fc-808389a2d558 (b3ca9209-c872-4273-a2fc-808389a2d558): created successfully Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5340bfe3-46ae-4e94-9543-a69ba171d6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Flow 'volume_create_manager' (bf3ec26e-5d12-4e5e-b0bc-19394567667a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:44 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9d29fca7-d162-4a60-871e-30839dc94f94 tempest-VolumeImageDependencyTests-2010420213 None] Created volume successfully. Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:44 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:30:44 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:44 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309" returned: 0 in 0.859s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:44 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309 is being set with open permissions: ugo+rw Jun 02 16:30:44 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:44 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309 Jun 02 16:30:44 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:45 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef" returned: 0 in 0.865s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:45 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.706s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:45 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:30:45 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] Deleted volume successfully. Jun 02 16:30:45 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef Jun 02 16:30:45 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:45 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-8ce5b05c-96de-4fff-873a-1c3c5c316267 tempest-CinderUnicodeTest-2129592764 None] Lock "cinder-5fca44d7-a30c-41d5-b802-14d20e00153a-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:45 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309" returned: 0 in 0.840s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:45 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:45 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.info Jun 02 16:30:45 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Acquiring lock "cinder-b3ca9209-c872-4273-a2fc-808389a2d558-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Lock "cinder-b3ca9209-c872-4273-a2fc-808389a2d558-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Acquiring lock "cinder-quobyte-b3ca9209-c872-4273-a2fc-808389a2d558" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Lock "cinder-quobyte-b3ca9209-c872-4273-a2fc-808389a2d558" acquired by "delete_volume" :: waited 0.026s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:46 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa2cf88-6e0a-41fe-bfbd-43b8e7750532]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:46 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba.61d30db7-4aac-40ca-97df-a2c64a874aef" returned: 0 in 0.815s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-quobyte-61d30db7-4aac-40ca-97df-a2c64a874aef" released by "_delete_snapshot" :: held 3.810s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:46 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 Jun 02 16:30:46 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-quobyte-6c594979-1de4-4444-aebc-1d7e7e62b9ba" released by "delete_snapshot" :: held 3.878s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:46 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Created reservations ['6feeb459-17ab-41fb-974f-7ff7daadc40e', '47d7605a-37b5-46f9-9f95-0abc9846f3d3', 'd547ce78-1fb9-4dd0-aa92-bace7e2819b0', '06da46f6-793d-4404-81d4-0fe3be9e36bc'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:30:46 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.info" returned: 0 in 0.696s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:46 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.info is being set with open permissions: ugo+rw Jun 02 16:30:46 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:46 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.info Jun 02 16:30:46 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:46 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Delete snapshot completed successfully. Jun 02 16:30:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-9c901404-560e-4629-85a2-d79321d74920 tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-61d30db7-4aac-40ca-97df-a2c64a874aef-delete_snapshot" released by "delete_snapshot" :: held 4.127s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "cinder-6c594979-1de4-4444-aebc-1d7e7e62b9ba-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-6c594979-1de4-4444-aebc-1d7e7e62b9ba-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "cinder-quobyte-6c594979-1de4-4444-aebc-1d7e7e62b9ba" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:46 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-quobyte-6c594979-1de4-4444-aebc-1d7e7e62b9ba" acquired by "delete_volume" :: waited 0.030s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:47 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[641a0fd2-08b8-427a-ac24-279496bb38f9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:47 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558" returned: 0 in 0.926s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:47 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba Jun 02 16:30:47 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:47 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 Jun 02 16:30:47 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:47 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.info" returned: 0 in 0.833s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.695s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:47 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-b4b54eb7-20cb-4e58-b6a1-cc40293a718e tempest-VolumeDependencyTests-1023081523 None] Create snapshot completed successfully Jun 02 16:30:47 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba" returned: 0 in 0.889s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:47 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558" returned: 1 in 0.813s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558' failed. Not Retrying. {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 16:30:47 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:47 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba Jun 02 16:30:47 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:48 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558 Jun 02 16:30:48 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:48 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-6c594979-1de4-4444-aebc-1d7e7e62b9ba" returned: 0 in 0.798s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-quobyte-6c594979-1de4-4444-aebc-1d7e7e62b9ba" released by "delete_volume" :: held 1.767s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Flow 'volume_create_manager' (f2b744ea-373d-499b-9328-928a2e13ea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ade5677-6608-4638-b51d-c72c33fc58d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:48 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b3ca9209-c872-4273-a2fc-808389a2d558" returned: 0 in 0.878s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ade5677-6608-4638-b51d-c72c33fc58d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1540020267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21abe415-8c57-475f-b557-cbedf18d7575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93a05a0076949b3a42ad0b3bb0c4fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ade7106d-0222-42a7-9ec1-e927ab77e309,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:49Z,use_quota=True,user_id='9964db6896eb44a38eb5f3a995776a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219e1ce2-9879-40b6-bd0e-36c70c69c1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219e1ce2-9879-40b6-bd0e-36c70c69c1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b00092-ac8b-4659-84c8-711fcb469456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b00092-ac8b-4659-84c8-711fcb469456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '21abe415-8c57-475f-b557-cbedf18d7575', 'volume_name': 'volume-21abe415-8c57-475f-b557-cbedf18d7575', 'volume_size': 1, 'snapshot_id': 'ade7106d-0222-42a7-9ec1-e927ab77e309'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93eecf67-135d-4ba6-b94f-16eb9a9225d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93eecf67-135d-4ba6-b94f-16eb9a9225d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdbc4591-0e29-4bc3-a366-449cab23be09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:48 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Volume 21abe415-8c57-475f-b557-cbedf18d7575: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-21abe415-8c57-475f-b557-cbedf18d7575', 'volume_size': 1, 'snapshot_id': 'ade7106d-0222-42a7-9ec1-e927ab77e309'} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Lock "cinder-quobyte-b3ca9209-c872-4273-a2fc-808389a2d558" released by "delete_volume" :: held 2.766s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] Created reservations ['72a4b098-aba5-4882-95b5-3b4134819d97', 'b92367fc-d096-46cf-9043-a85c8fa783fb', '93364db2-ebd2-4392-9299-68f81a7baf8f', '6b742cfd-5906-4153-a74c-997afb706c58'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Acquiring lock "cinder-quobyte-ade7106d-0222-42a7-9ec1-e927ab77e309-21abe415-8c57-475f-b557-cbedf18d7575" by "_create_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-quobyte-ade7106d-0222-42a7-9ec1-e927ab77e309-21abe415-8c57-475f-b557-cbedf18d7575" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Creating volume 21abe415-8c57-475f-b557-cbedf18d7575 from snapshot ade7106d-0222-42a7-9ec1-e927ab77e309 {{(pid=86488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Acquiring lock "cinder-quobyte-21abe415-8c57-475f-b557-cbedf18d7575" by "_copy_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-quobyte-21abe415-8c57-475f-b557-cbedf18d7575" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] snapshot: ade7106d-0222-42a7-9ec1-e927ab77e309, volume: 21abe415-8c57-475f-b557-cbedf18d7575, {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 16:30:48 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Created reservations ['3559f193-92e2-4f4d-a445-b37bd12f89c2', '67f090b2-fdb3-4cc4-8d78-329ffd3d90f3', '8e76d7f6-9cdf-495f-8686-455890d9a62f', 'd1c37b53-0d80-4b06-b3e6-c2cf0614e8ea'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[e302918e-6dac-43b0-9402-e4650f5cb277]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:49 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:30:49 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:49 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309 Jun 02 16:30:49 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:49 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:49 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:30:49 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:50 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.029s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:50 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:30:50 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] Deleted volume successfully. Jun 02 16:30:50 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-74011fa7-4676-4962-bc16-6845617bbe5c tempest-CreateVolumesFromSnapshotTest-1613906066 None] Lock "cinder-6c594979-1de4-4444-aebc-1d7e7e62b9ba-delete_volume" released by "delete_volume" :: held 3.334s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:50 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309" returned: 0 in 1.183s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1697cdd-1500-4a3f-bf57-528f1de8a768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:30:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 16:30:50 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Creating direct copy from snapshot {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 16:30:50 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d450de-4b60-46d8-ae17-9aed1c115402]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:50 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:50 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 1.049s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:50 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:30:50 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Deleted volume successfully. Jun 02 16:30:50 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-5dbdb57e-ed2d-4e76-8b46-98284d290628 tempest-VolumeImageDependencyTests-2010420213 None] Lock "cinder-b3ca9209-c872-4273-a2fc-808389a2d558-delete_volume" released by "delete_volume" :: held 4.390s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:50 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 Jun 02 16:30:50 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:51 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768" returned: 0 in 0.961s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:51 devstack cinder-volume[86488]: DEBUG cinder.utils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Path /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21abe415-8c57-475f-b557-cbedf18d7575 not found in is_blk_device check {{(pid=86488) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 16:30:51 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21abe415-8c57-475f-b557-cbedf18d7575 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:51 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21abe415-8c57-475f-b557-cbedf18d7575 Jun 02 16:30:51 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:56 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:UPDATE=185,cinder:SELECT=130,cinder:INSERT=59,cinder:DELETE=14 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:30:56 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:30:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Flow 'volume_create_manager' (41f9040b-f308-4e78-9e2b-171009ad8f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cacd5abc-eae3-41e6-866c-c6b89a0b1917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cacd5abc-eae3-41e6-866c-c6b89a0b1917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1667608150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2228e598-6c99-4362-9a8a-f8cc8e05c62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af9bad873d0410589e106fcc1ceaa69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:56Z,use_quota=True,user_id='7b9a186aafb54854848a1b51baecc3fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff47aa04-2f44-47f4-be9d-90953c0cef4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff47aa04-2f44-47f4-be9d-90953c0cef4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1202e0a-cfdb-4cb5-ae43-6f77a876b254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1202e0a-cfdb-4cb5-ae43-6f77a876b254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2228e598-6c99-4362-9a8a-f8cc8e05c62b', 'volume_name': 'volume-2228e598-6c99-4362-9a8a-f8cc8e05c62b', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923feda3-3a4b-4429-8eb1-10d738d70dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923feda3-3a4b-4429-8eb1-10d738d70dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:56 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979c2169-490d-4c79-9ae2-4b6ee18fb5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:56 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume 2228e598-6c99-4362-9a8a-f8cc8e05c62b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2228e598-6c99-4362-9a8a-f8cc8e05c62b', 'volume_size': 1} Jun 02 16:30:56 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:57 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21abe415-8c57-475f-b557-cbedf18d7575" returned: 0 in 6.060s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:57 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c43e0f-f97b-4ab2-99e2-af09d2b4fd18]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:30:57 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:57 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 Jun 02 16:30:57 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:58 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768" returned: 0 in 0.960s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:58 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Image conversion details: src /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21abe415-8c57-475f-b557-cbedf18d7575 {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:30:58 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Converted 1024.00 MB image at 168.95 MB/s Jun 02 16:30:58 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21abe415-8c57-475f-b557-cbedf18d7575 is being set with open permissions: ugo+rw Jun 02 16:30:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21abe415-8c57-475f-b557-cbedf18d7575 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:58 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21abe415-8c57-475f-b557-cbedf18d7575 Jun 02 16:30:58 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:58 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21abe415-8c57-475f-b557-cbedf18d7575" returned: 0 in 0.646s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:58 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-quobyte-21abe415-8c57-475f-b557-cbedf18d7575" released by "_copy_volume_from_snapshot" :: held 9.963s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:58 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-quobyte-ade7106d-0222-42a7-9ec1-e927ab77e309-21abe415-8c57-475f-b557-cbedf18d7575" released by "_create_volume_from_snapshot" :: held 10.008s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:30:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.037s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.697s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1667608150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2228e598-6c99-4362-9a8a-f8cc8e05c62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af9bad873d0410589e106fcc1ceaa69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:30:56Z,use_quota=True,user_id='7b9a186aafb54854848a1b51baecc3fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:30:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Creating volume 2228e598-6c99-4362-9a8a-f8cc8e05c62b {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:30:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:30:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:30:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:30:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:30:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:30:58 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:30:58 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:30:58 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2228e598-6c99-4362-9a8a-f8cc8e05c62b 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:58 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2228e598-6c99-4362-9a8a-f8cc8e05c62b 1073741824 Jun 02 16:30:58 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdbc4591-0e29-4bc3-a366-449cab23be09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21abe415-8c57-475f-b557-cbedf18d7575', 'volume_size': 1, 'snapshot_id': 'ade7106d-0222-42a7-9ec1-e927ab77e309'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d08bf37-7359-4703-89ad-6f50c896bd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:30:59 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Volume volume-21abe415-8c57-475f-b557-cbedf18d7575 (21abe415-8c57-475f-b557-cbedf18d7575): created successfully Jun 02 16:30:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d08bf37-7359-4703-89ad-6f50c896bd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:30:59 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Flow 'volume_create_manager' (f2b744ea-373d-499b-9328-928a2e13ea85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:30:59 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-699bab19-c462-419b-a785-d15d1f5b6f23 tempest-VolumeDependencyTests-1023081523 None] Created volume successfully. Jun 02 16:30:59 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jun 02 16:30:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2228e598-6c99-4362-9a8a-f8cc8e05c62b 1073741824" returned: 0 in 0.841s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:30:59 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2228e598-6c99-4362-9a8a-f8cc8e05c62b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:30:59 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2228e598-6c99-4362-9a8a-f8cc8e05c62b Jun 02 16:30:59 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:30:59 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] Acquiring lock "cinder-ade7106d-0222-42a7-9ec1-e927ab77e309-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:59 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-ade7106d-0222-42a7-9ec1-e927ab77e309-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:59 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] Acquiring lock "cinder-quobyte-a1697cdd-1500-4a3f-bf57-528f1de8a768" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:30:59 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-quobyte-a1697cdd-1500-4a3f-bf57-528f1de8a768" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:30:59 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] Acquiring lock "cinder-quobyte-ade7106d-0222-42a7-9ec1-e927ab77e309" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-quobyte-ade7106d-0222-42a7-9ec1-e927ab77e309" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] Deleting offline snapshot ade7106d-0222-42a7-9ec1-e927ab77e309 of volume a1697cdd-1500-4a3f-bf57-528f1de8a768 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] snapshot_file for this snap is: volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3279b322-4666-44f3-8a41-770f8ff2532c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:00 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:31:00 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:00 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309 Jun 02 16:31:00 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:00 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2228e598-6c99-4362-9a8a-f8cc8e05c62b" returned: 0 in 0.905s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979c2169-490d-4c79-9ae2-4b6ee18fb5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2228e598-6c99-4362-9a8a-f8cc8e05c62b', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b640c1-bf39-4eb9-a2e1-2d51485a3058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:00 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume volume-2228e598-6c99-4362-9a8a-f8cc8e05c62b (2228e598-6c99-4362-9a8a-f8cc8e05c62b): created successfully Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b640c1-bf39-4eb9-a2e1-2d51485a3058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Flow 'volume_create_manager' (41f9040b-f308-4e78-9e2b-171009ad8f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=158,cinder:UPDATE=196,cinder:INSERT=47,cinder:DELETE=20 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:31:00 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-624e7015-98fe-445c-bbc9-32b1919e1d00 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Created volume successfully. Jun 02 16:31:00 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:00 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309" returned: 0 in 0.869s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1697cdd-1500-4a3f-bf57-528f1de8a768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.827s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42cd814-d85f-402d-a01c-95d5f622907d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:01 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 Jun 02 16:31:01 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:01 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768" returned: 0 in 0.785s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:01 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:01 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309 Jun 02 16:31:01 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:01 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:31:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Flow 'volume_create_manager' (f2cd44df-3ddd-4063-863c-4e998c72d361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:31:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc963dd-ae33-4746-882a-b3a248e36801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:01 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc963dd-ae33-4746-882a-b3a248e36801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1362701133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e59c04-e454-4bc5-abe2-ab3a70bf08de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af9bad873d0410589e106fcc1ceaa69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:31:02Z,use_quota=True,user_id='7b9a186aafb54854848a1b51baecc3fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f85999-2c53-4b31-b0bc-836fd15d5409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f85999-2c53-4b31-b0bc-836fd15d5409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5209dfd-37a8-4711-a785-e140cf6f43de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5209dfd-37a8-4711-a785-e140cf6f43de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42e59c04-e454-4bc5-abe2-ab3a70bf08de', 'volume_name': 'volume-42e59c04-e454-4bc5-abe2-ab3a70bf08de', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ce6f5f-f43e-413c-8cfa-3f78d05e712b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ce6f5f-f43e-413c-8cfa-3f78d05e712b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ec67ad-fde0-4f9e-ba7d-605ce86156d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:02 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume 42e59c04-e454-4bc5-abe2-ab3a70bf08de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42e59c04-e454-4bc5-abe2-ab3a70bf08de', 'volume_size': 1} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1362701133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e59c04-e454-4bc5-abe2-ab3a70bf08de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af9bad873d0410589e106fcc1ceaa69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:31:02Z,use_quota=True,user_id='7b9a186aafb54854848a1b51baecc3fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Creating volume 42e59c04-e454-4bc5-abe2-ab3a70bf08de {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:31:02 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-42e59c04-e454-4bc5-abe2-ab3a70bf08de 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:02 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-42e59c04-e454-4bc5-abe2-ab3a70bf08de 1073741824 Jun 02 16:31:02 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Flow 'volume_create_manager' (223d55f0-6103-49d6-b425-7cbe361555f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cbd8147-394c-4efd-b22a-919f6545d799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cbd8147-394c-4efd-b22a-919f6545d799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1451865170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b886e73f-5ec2-44c3-bced-af69b87fe8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af9bad873d0410589e106fcc1ceaa69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:31:02Z,use_quota=True,user_id='7b9a186aafb54854848a1b51baecc3fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae82a1e-98bc-4238-908d-f522dce107bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae82a1e-98bc-4238-908d-f522dce107bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27dbccdc-dc5f-4aa9-85f8-60f8d07271c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27dbccdc-dc5f-4aa9-85f8-60f8d07271c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b886e73f-5ec2-44c3-bced-af69b87fe8e0', 'volume_name': 'volume-b886e73f-5ec2-44c3-bced-af69b87fe8e0', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dd68bf-5426-407a-8ab9-f2079267e945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dd68bf-5426-407a-8ab9-f2079267e945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6976314b-9600-4f5a-b13e-8b48c449a118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:02 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume b886e73f-5ec2-44c3-bced-af69b87fe8e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b886e73f-5ec2-44c3-bced-af69b87fe8e0', 'volume_size': 1} Jun 02 16:31:02 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:03 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309" returned: 0 in 1.314s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:03 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309 Jun 02 16:31:03 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Flow 'volume_create_manager' (fae8ffb9-3e72-4567-b89f-eead557bdd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdf1a9e-9f3e-4ac8-8c41-2ef6707c4700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdf1a9e-9f3e-4ac8-8c41-2ef6707c4700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1091157885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6b1c91-820f-415c-a262-dff8f7288c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af9bad873d0410589e106fcc1ceaa69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:31:03Z,use_quota=True,user_id='7b9a186aafb54854848a1b51baecc3fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f30c71-944b-43b6-95a1-066e1bedabf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f30c71-944b-43b6-95a1-066e1bedabf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23fcdc9-6155-49b8-8f2a-5f2f7ae058a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23fcdc9-6155-49b8-8f2a-5f2f7ae058a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd6b1c91-820f-415c-a262-dff8f7288c5f', 'volume_name': 'volume-dd6b1c91-820f-415c-a262-dff8f7288c5f', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02cf02ef-c213-4110-ad52-b10cb6d07cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:03 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02cf02ef-c213-4110-ad52-b10cb6d07cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8505230-729c-4797-8352-1621d01d7002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:03 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume dd6b1c91-820f-415c-a262-dff8f7288c5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd6b1c91-820f-415c-a262-dff8f7288c5f', 'volume_size': 1} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-42e59c04-e454-4bc5-abe2-ab3a70bf08de 1073741824" returned: 0 in 1.331s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-42e59c04-e454-4bc5-abe2-ab3a70bf08de {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:03 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-42e59c04-e454-4bc5-abe2-ab3a70bf08de Jun 02 16:31:03 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Flow 'volume_create_manager' (dda8b828-1b11-4f48-aab8-2b772ca31de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6413de2-8ca2-4d35-a205-7fa252606c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6413de2-8ca2-4d35-a205-7fa252606c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-419873963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91542f84-5281-4e0f-a39c-8bb9332629db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af9bad873d0410589e106fcc1ceaa69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:31:04Z,use_quota=True,user_id='7b9a186aafb54854848a1b51baecc3fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66a45e7-00f3-42da-a9c5-5a14ddb7f0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66a45e7-00f3-42da-a9c5-5a14ddb7f0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3533385-cde5-4d82-8afa-a02983f2c4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3533385-cde5-4d82-8afa-a02983f2c4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91542f84-5281-4e0f-a39c-8bb9332629db', 'volume_name': 'volume-91542f84-5281-4e0f-a39c-8bb9332629db', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce06f90-eda8-4c19-9734-6986fa6b7f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce06f90-eda8-4c19-9734-6986fa6b7f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cd6722-4d8d-4279-a4d4-4adf9b475222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:03 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume 91542f84-5281-4e0f-a39c-8bb9332629db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91542f84-5281-4e0f-a39c-8bb9332629db', 'volume_size': 1} Jun 02 16:31:03 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768.ade7106d-0222-42a7-9ec1-e927ab77e309" returned: 0 in 1.103s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:04 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-quobyte-ade7106d-0222-42a7-9ec1-e927ab77e309" released by "_delete_snapshot" :: held 4.259s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Flow 'volume_create_manager' (d38aa667-05d1-4bef-8579-13851a4014b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bccc1a2-1c1a-49f5-98ea-7f20763485aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-quobyte-a1697cdd-1500-4a3f-bf57-528f1de8a768" released by "delete_snapshot" :: held 4.356s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bccc1a2-1c1a-49f5-98ea-7f20763485aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-285680904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=586581ab-b422-44d6-be57-ba7ea1c85093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af9bad873d0410589e106fcc1ceaa69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:31:04Z,use_quota=True,user_id='7b9a186aafb54854848a1b51baecc3fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83282deb-363f-4d3c-b303-6ef7a907f0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83282deb-363f-4d3c-b303-6ef7a907f0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421aa570-977f-40a0-8a02-ea57b8f62d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421aa570-977f-40a0-8a02-ea57b8f62d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '586581ab-b422-44d6-be57-ba7ea1c85093', 'volume_name': 'volume-586581ab-b422-44d6-be57-ba7ea1c85093', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1a27db-8217-4475-9a65-39478e30aa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1a27db-8217-4475-9a65-39478e30aa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6febdca-31e2-482b-87da-a98162b6d850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:04 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume 586581ab-b422-44d6-be57-ba7ea1c85093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-586581ab-b422-44d6-be57-ba7ea1c85093', 'volume_size': 1} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:04 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-42e59c04-e454-4bc5-abe2-ab3a70bf08de" returned: 0 in 1.008s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] <== create_volume: return (2394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.397s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.816s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1451865170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b886e73f-5ec2-44c3-bced-af69b87fe8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af9bad873d0410589e106fcc1ceaa69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:31:02Z,use_quota=True,user_id='7b9a186aafb54854848a1b51baecc3fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Creating volume b886e73f-5ec2-44c3-bced-af69b87fe8e0 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:31:04 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b886e73f-5ec2-44c3-bced-af69b87fe8e0 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:04 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b886e73f-5ec2-44c3-bced-af69b87fe8e0 1073741824 Jun 02 16:31:04 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ec67ad-fde0-4f9e-ba7d-605ce86156d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42e59c04-e454-4bc5-abe2-ab3a70bf08de', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cb2a6e-4bf0-47af-957b-c74e8774d301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] Created reservations ['b261e81f-bebb-4cbb-be13-0ce941152878', 'd23402e3-a254-4328-bab8-30d2fa8d76e5', 'c7b9e14c-a1ef-40c3-8292-1fa5b77761ee', 'aa137cee-65f2-4256-aca2-95675f134bbe'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:31:04 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume volume-42e59c04-e454-4bc5-abe2-ab3a70bf08de (42e59c04-e454-4bc5-abe2-ab3a70bf08de): created successfully Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cb2a6e-4bf0-47af-957b-c74e8774d301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Flow 'volume_create_manager' (f2cd44df-3ddd-4063-863c-4e998c72d361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:31:04 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-8f262f10-7647-4fdf-9c39-878569c2a82e tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Created volume successfully. Jun 02 16:31:04 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] Delete snapshot completed successfully. Jun 02 16:31:04 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-c1c52511-b284-4e79-8fed-a0ef56cce52b tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-ade7106d-0222-42a7-9ec1-e927ab77e309-delete_snapshot" released by "delete_snapshot" :: held 4.695s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:05 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b886e73f-5ec2-44c3-bced-af69b87fe8e0 1073741824" returned: 0 in 0.947s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] Acquiring lock "cinder-a1697cdd-1500-4a3f-bf57-528f1de8a768-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-a1697cdd-1500-4a3f-bf57-528f1de8a768-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b886e73f-5ec2-44c3-bced-af69b87fe8e0 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:05 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b886e73f-5ec2-44c3-bced-af69b87fe8e0 Jun 02 16:31:05 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] Acquiring lock "cinder-quobyte-a1697cdd-1500-4a3f-bf57-528f1de8a768" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:05 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-quobyte-a1697cdd-1500-4a3f-bf57-528f1de8a768" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:05 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[a151ac0c-420a-4715-8ca9-17386c3648e1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:05 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:05 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 Jun 02 16:31:05 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:06 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b886e73f-5ec2-44c3-bced-af69b87fe8e0" returned: 0 in 0.647s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.712s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1091157885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6b1c91-820f-415c-a262-dff8f7288c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af9bad873d0410589e106fcc1ceaa69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:31:03Z,use_quota=True,user_id='7b9a186aafb54854848a1b51baecc3fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Creating volume dd6b1c91-820f-415c-a262-dff8f7288c5f {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:31:06 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-dd6b1c91-820f-415c-a262-dff8f7288c5f 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:06 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-dd6b1c91-820f-415c-a262-dff8f7288c5f 1073741824 Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6976314b-9600-4f5a-b13e-8b48c449a118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b886e73f-5ec2-44c3-bced-af69b87fe8e0', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:06 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9030f655-bc19-4af3-9d13-f6ab09c0a180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:06 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume volume-b886e73f-5ec2-44c3-bced-af69b87fe8e0 (b886e73f-5ec2-44c3-bced-af69b87fe8e0): created successfully Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9030f655-bc19-4af3-9d13-f6ab09c0a180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Flow 'volume_create_manager' (223d55f0-6103-49d6-b425-7cbe361555f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:31:06 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-e3cfcf55-9eb7-42a3-b51b-fa85bb71d25f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Created volume successfully. Jun 02 16:31:06 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768" returned: 0 in 0.799s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:06 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:06 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768 Jun 02 16:31:06 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:06 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-a1697cdd-1500-4a3f-bf57-528f1de8a768" returned: 0 in 0.619s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-quobyte-a1697cdd-1500-4a3f-bf57-528f1de8a768" released by "delete_volume" :: held 1.510s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] Created reservations ['8fca7fcf-51f8-4637-9ff9-2e45b3ecde52', 'dffe4c29-4726-4603-aab8-c68c978e2d68', '3ec950c5-8804-4d80-af26-d3a6863e711d', '04f708f9-744e-43d4-8c80-2fa5a7644cf6'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:31:07 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-dd6b1c91-820f-415c-a262-dff8f7288c5f 1073741824" returned: 0 in 0.977s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-dd6b1c91-820f-415c-a262-dff8f7288c5f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:07 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-dd6b1c91-820f-415c-a262-dff8f7288c5f Jun 02 16:31:07 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:07 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:31:07 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] Acquiring lock "cinder-21abe415-8c57-475f-b557-cbedf18d7575-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-21abe415-8c57-475f-b557-cbedf18d7575-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] Acquiring lock "cinder-quobyte-21abe415-8c57-475f-b557-cbedf18d7575" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-quobyte-21abe415-8c57-475f-b557-cbedf18d7575" acquired by "delete_volume" :: waited 0.019s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[00233f74-5986-4dc8-b72c-2344d4776d4c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:07 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21abe415-8c57-475f-b557-cbedf18d7575 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-dd6b1c91-820f-415c-a262-dff8f7288c5f" returned: 0 in 0.722s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.910s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-419873963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91542f84-5281-4e0f-a39c-8bb9332629db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af9bad873d0410589e106fcc1ceaa69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:31:04Z,use_quota=True,user_id='7b9a186aafb54854848a1b51baecc3fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Creating volume 91542f84-5281-4e0f-a39c-8bb9332629db {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:31:07 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-91542f84-5281-4e0f-a39c-8bb9332629db 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8505230-729c-4797-8352-1621d01d7002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd6b1c91-820f-415c-a262-dff8f7288c5f', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:07 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:07 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-91542f84-5281-4e0f-a39c-8bb9332629db 1073741824 Jun 02 16:31:07 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a7dd4b-c473-4965-b6c0-1d72e2583e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.742s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:31:07 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] Deleted volume successfully. Jun 02 16:31:07 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume volume-dd6b1c91-820f-415c-a262-dff8f7288c5f (dd6b1c91-820f-415c-a262-dff8f7288c5f): created successfully Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a7dd4b-c473-4965-b6c0-1d72e2583e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:07 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Flow 'volume_create_manager' (fae8ffb9-3e72-4567-b89f-eead557bdd3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:31:08 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21abe415-8c57-475f-b557-cbedf18d7575 Jun 02 16:31:08 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:08 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-148b78d0-5553-43fa-b3a4-44ceb89662ba tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-a1697cdd-1500-4a3f-bf57-528f1de8a768-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:08 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-1f7efe86-db57-46e4-88da-f99fd8fc5bc2 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Created volume successfully. Jun 02 16:31:08 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21abe415-8c57-475f-b557-cbedf18d7575" returned: 0 in 0.827s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21abe415-8c57-475f-b557-cbedf18d7575 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:08 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21abe415-8c57-475f-b557-cbedf18d7575 Jun 02 16:31:08 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:08 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-91542f84-5281-4e0f-a39c-8bb9332629db 1073741824" returned: 0 in 1.002s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:08 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-91542f84-5281-4e0f-a39c-8bb9332629db {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:08 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-91542f84-5281-4e0f-a39c-8bb9332629db Jun 02 16:31:08 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:09 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-21abe415-8c57-475f-b557-cbedf18d7575" returned: 0 in 0.692s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-quobyte-21abe415-8c57-475f-b557-cbedf18d7575" released by "delete_volume" :: held 1.576s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] Created reservations ['595874e6-9e48-4385-9f4b-428fb5438b9d', '9d236fa8-7ac1-4f5b-80b1-fd04395fb2ee', '996dd2d9-d892-4500-948e-8db7cf3bb8bc', 'f47f35ee-34b0-4e43-aa58-583bc6241bb9'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:09 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:31:09 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:09 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-91542f84-5281-4e0f-a39c-8bb9332629db" returned: 0 in 0.716s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.268s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-285680904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=586581ab-b422-44d6-be57-ba7ea1c85093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af9bad873d0410589e106fcc1ceaa69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:31:04Z,use_quota=True,user_id='7b9a186aafb54854848a1b51baecc3fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Creating volume 586581ab-b422-44d6-be57-ba7ea1c85093 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:31:09 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-586581ab-b422-44d6-be57-ba7ea1c85093 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cd6722-4d8d-4279-a4d4-4adf9b475222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91542f84-5281-4e0f-a39c-8bb9332629db', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:09 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-586581ab-b422-44d6-be57-ba7ea1c85093 1073741824 Jun 02 16:31:09 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1382f5c8-e89a-4f96-aefa-bf6c0bf74352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:09 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume volume-91542f84-5281-4e0f-a39c-8bb9332629db (91542f84-5281-4e0f-a39c-8bb9332629db): created successfully Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1382f5c8-e89a-4f96-aefa-bf6c0bf74352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:09 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Flow 'volume_create_manager' (dda8b828-1b11-4f48-aab8-2b772ca31de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:31:09 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-33b97568-4b56-4d76-8e03-30c09b43ee82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Created volume successfully. Jun 02 16:31:10 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.708s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:10 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:31:10 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] Deleted volume successfully. Jun 02 16:31:10 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7578ef3c-eeba-41a2-abe7-e5f15bb46198 tempest-VolumeDependencyTests-1023081523 None] Lock "cinder-21abe415-8c57-475f-b557-cbedf18d7575-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:10 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-586581ab-b422-44d6-be57-ba7ea1c85093 1073741824" returned: 0 in 0.925s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:10 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-586581ab-b422-44d6-be57-ba7ea1c85093 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:10 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-586581ab-b422-44d6-be57-ba7ea1c85093 Jun 02 16:31:10 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:11 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-586581ab-b422-44d6-be57-ba7ea1c85093" returned: 0 in 0.748s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:11 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:31:11 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6febdca-31e2-482b-87da-a98162b6d850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-586581ab-b422-44d6-be57-ba7ea1c85093', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475b98b1-3c4f-4484-98f1-6965ed98435b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:11 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Volume volume-586581ab-b422-44d6-be57-ba7ea1c85093 (586581ab-b422-44d6-be57-ba7ea1c85093): created successfully Jun 02 16:31:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475b98b1-3c4f-4484-98f1-6965ed98435b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:11 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Flow 'volume_create_manager' (d38aa667-05d1-4bef-8579-13851a4014b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:31:11 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-ffc77a5f-ddea-4e8b-911f-e383a759431d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Created volume successfully. Jun 02 16:31:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "cinder-586581ab-b422-44d6-be57-ba7ea1c85093-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-586581ab-b422-44d6-be57-ba7ea1c85093-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "cinder-quobyte-586581ab-b422-44d6-be57-ba7ea1c85093" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:12 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-quobyte-586581ab-b422-44d6-be57-ba7ea1c85093" acquired by "delete_volume" :: waited 0.023s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:12 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef41a9a8-0ace-42cc-a851-f5a91f28eb43]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-586581ab-b422-44d6-be57-ba7ea1c85093 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:12 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-586581ab-b422-44d6-be57-ba7ea1c85093 Jun 02 16:31:12 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:12 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-586581ab-b422-44d6-be57-ba7ea1c85093" returned: 0 in 0.714s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:12 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-586581ab-b422-44d6-be57-ba7ea1c85093 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:12 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-586581ab-b422-44d6-be57-ba7ea1c85093 Jun 02 16:31:12 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:13 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-586581ab-b422-44d6-be57-ba7ea1c85093" returned: 0 in 0.629s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:13 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-quobyte-586581ab-b422-44d6-be57-ba7ea1c85093" released by "delete_volume" :: held 1.393s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:13 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Created reservations ['586bc2f6-cdd7-43ee-ac13-61040be37674', 'fb72ab80-91d0-4e3d-8e82-c838ba1f4e2a', '7aff9c1e-9f51-4683-ad67-0b282adf20a8', 'ac4c4019-6ec1-4c98-980b-8a86920b234e'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:31:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:13 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:13 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:13 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:31:13 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:14 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.618s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:14 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:31:14 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Deleted volume successfully. Jun 02 16:31:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-095a9022-9ebc-4c7b-866f-583a2ee71709 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-586581ab-b422-44d6-be57-ba7ea1c85093-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "cinder-91542f84-5281-4e0f-a39c-8bb9332629db-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-91542f84-5281-4e0f-a39c-8bb9332629db-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "cinder-quobyte-91542f84-5281-4e0f-a39c-8bb9332629db" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:14 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-quobyte-91542f84-5281-4e0f-a39c-8bb9332629db" acquired by "delete_volume" :: waited 0.020s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:14 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aba1097-6c8e-40cd-bcb6-16270bf7140c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:14 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-91542f84-5281-4e0f-a39c-8bb9332629db {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:14 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-91542f84-5281-4e0f-a39c-8bb9332629db Jun 02 16:31:14 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:15 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-91542f84-5281-4e0f-a39c-8bb9332629db" returned: 0 in 0.739s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-91542f84-5281-4e0f-a39c-8bb9332629db {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:15 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-91542f84-5281-4e0f-a39c-8bb9332629db Jun 02 16:31:15 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:15 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:15 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-91542f84-5281-4e0f-a39c-8bb9332629db" returned: 0 in 0.713s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:15 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-quobyte-91542f84-5281-4e0f-a39c-8bb9332629db" released by "delete_volume" :: held 1.507s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:16 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Created reservations ['b00b5b86-468a-4e2c-beb7-1aeed8933931', 'ac72756f-47c6-4139-ada5-29f62e092d37', '4c684aa5-9e41-4942-bc44-4e536d1bd607', '0eb81c8a-1930-4572-bf29-13a3127c39f1'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:31:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:16 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:16 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:31:16 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "cinder-dd6b1c91-820f-415c-a262-dff8f7288c5f-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-dd6b1c91-820f-415c-a262-dff8f7288c5f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "cinder-quobyte-dd6b1c91-820f-415c-a262-dff8f7288c5f" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-quobyte-dd6b1c91-820f-415c-a262-dff8f7288c5f" acquired by "delete_volume" :: waited 0.017s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:16 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbd63ff-18a4-4258-91f4-39804201010c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-dd6b1c91-820f-415c-a262-dff8f7288c5f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:16 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:16 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.729s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:16 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:31:16 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Deleted volume successfully. Jun 02 16:31:16 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-7a1ee449-097a-47b5-bcc9-ad35930edc82 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-91542f84-5281-4e0f-a39c-8bb9332629db-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:16 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-dd6b1c91-820f-415c-a262-dff8f7288c5f Jun 02 16:31:16 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:17 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-dd6b1c91-820f-415c-a262-dff8f7288c5f" returned: 0 in 0.741s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-dd6b1c91-820f-415c-a262-dff8f7288c5f {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:17 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-dd6b1c91-820f-415c-a262-dff8f7288c5f Jun 02 16:31:17 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Flow 'volume_create_manager' (7ca82f05-1cf6-460e-b181-14b11ce78b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d454f0-6858-4bb9-b5db-62a6da759dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d454f0-6858-4bb9-b5db-62a6da759dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-822014645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8398fcaf-8282-4e4c-b14d-2778e5c7d622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652a7e582c544231a353f80cb3f3a404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:31:18Z,use_quota=True,user_id='4019a48e4bad483590665c084907a7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423f67dd-77f1-43df-9c5c-fa202fca69fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423f67dd-77f1-43df-9c5c-fa202fca69fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (049e96fa-ea67-44f0-aa73-f46431347504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (049e96fa-ea67-44f0-aa73-f46431347504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8398fcaf-8282-4e4c-b14d-2778e5c7d622', 'volume_name': 'volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d92b738-3d88-4c04-94cb-f67267cfb0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d92b738-3d88-4c04-94cb-f67267cfb0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69f9900-888a-47cc-b61d-bc7435aed015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:17 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Volume 8398fcaf-8282-4e4c-b14d-2778e5c7d622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622', 'volume_size': 1} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-822014645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8398fcaf-8282-4e4c-b14d-2778e5c7d622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652a7e582c544231a353f80cb3f3a404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:31:18Z,use_quota=True,user_id='4019a48e4bad483590665c084907a7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)}" {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Creating volume 8398fcaf-8282-4e4c-b14d-2778e5c7d622 {{(pid=86488) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:31:17 devstack cinder-volume[86488]: INFO cinder.volume.drivers.remotefs [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] casted to osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 Jun 02 16:31:17 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 1073741824 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:17 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 1073741824 Jun 02 16:31:17 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:18 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-dd6b1c91-820f-415c-a262-dff8f7288c5f" returned: 0 in 0.661s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-quobyte-dd6b1c91-820f-415c-a262-dff8f7288c5f" released by "delete_volume" :: held 1.452s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:18 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Created reservations ['7051d748-d9f4-4e9b-aed7-263b272ba0aa', 'c008c721-78d5-49fb-a8eb-293d41e58d2b', 'f5c855b6-0765-4f03-b7d1-9d6bbcfef3b8', '2cd78e90-7bfb-4243-9df0-110ae332fe6c'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:31:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:18 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:18 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:31:18 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:18 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 1073741824" returned: 0 in 0.785s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:18 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 Jun 02 16:31:18 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:18 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "cinder-b886e73f-5ec2-44c3-bced-af69b87fe8e0-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:18 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:18 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.614s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:18 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:31:18 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Deleted volume successfully. Jun 02 16:31:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-b886e73f-5ec2-44c3-bced-af69b87fe8e0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-b0f69a76-5234-407f-840c-637e8c877488 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-dd6b1c91-820f-415c-a262-dff8f7288c5f-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "cinder-quobyte-b886e73f-5ec2-44c3-bced-af69b87fe8e0" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:19 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-quobyte-b886e73f-5ec2-44c3-bced-af69b87fe8e0" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:19 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf6e63b-f6ad-400d-9e4c-39ba09a812a0]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b886e73f-5ec2-44c3-bced-af69b87fe8e0 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:19 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622" returned: 0 in 0.633s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:19 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'} {{(pid=86488) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 16:31:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:19 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b886e73f-5ec2-44c3-bced-af69b87fe8e0 Jun 02 16:31:19 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69f9900-888a-47cc-b61d-bc7435aed015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622', 'volume_size': 1}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9ebb80-89d5-4be5-b8c9-3f6c12e63947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:19 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Volume volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 (8398fcaf-8282-4e4c-b14d-2778e5c7d622): created successfully Jun 02 16:31:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9ebb80-89d5-4be5-b8c9-3f6c12e63947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:19 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Flow 'volume_create_manager' (7ca82f05-1cf6-460e-b181-14b11ce78b58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:31:19 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-9a62be09-d0bd-494a-9c73-01443369e3ab tempest-SnapshotDependencyTests-1712593002 None] Created volume successfully. Jun 02 16:31:19 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b886e73f-5ec2-44c3-bced-af69b87fe8e0" returned: 0 in 0.733s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:19 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b886e73f-5ec2-44c3-bced-af69b87fe8e0 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:19 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b886e73f-5ec2-44c3-bced-af69b87fe8e0 Jun 02 16:31:19 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] Creating offline snapshot 70064d96-e6dd-43c5-b0c4-04cc0c63108d of volume 8398fcaf-8282-4e4c-b14d-2778e5c7d622 {{(pid=86488) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 02 16:31:20 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e09c888-5fe1-44cc-8cfc-7a92f72548e9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:20 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 Jun 02 16:31:20 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:20 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-b886e73f-5ec2-44c3-bced-af69b87fe8e0" returned: 0 in 0.626s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:20 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-quobyte-b886e73f-5ec2-44c3-bced-af69b87fe8e0" released by "delete_volume" :: held 1.403s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:20 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Created reservations ['0ef554cc-a1bf-4d40-a136-0e2aae2dc93d', '310023d3-71ab-493f-829b-b9cd60df7b03', '3c20812a-63d9-46d6-b2fd-a00ec0bd2a28', '19c86402-c61a-4e19-8c38-e93406baeef5'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:31:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:20 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:20 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:31:20 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:20 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622" returned: 0 in 0.783s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:20 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d 1G {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:20 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d 1G Jun 02 16:31:20 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:21 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "cinder-42e59c04-e454-4bc5-abe2-ab3a70bf08de-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:21 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.639s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:21 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:31:21 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Deleted volume successfully. Jun 02 16:31:21 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-42e59c04-e454-4bc5-abe2-ab3a70bf08de-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:21 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-e455c6a0-d270-431d-8a4a-e38ffd64d66d tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-b886e73f-5ec2-44c3-bced-af69b87fe8e0-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:21 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "cinder-quobyte-42e59c04-e454-4bc5-abe2-ab3a70bf08de" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:21 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-quobyte-42e59c04-e454-4bc5-abe2-ab3a70bf08de" acquired by "delete_volume" :: waited 0.019s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:21 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e140b39-bc8d-4554-8913-e88f555d46e1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-42e59c04-e454-4bc5-abe2-ab3a70bf08de {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:21 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-42e59c04-e454-4bc5-abe2-ab3a70bf08de Jun 02 16:31:21 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:21 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d 1G" returned: 0 in 0.844s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:21 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:21 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d Jun 02 16:31:21 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:22 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-42e59c04-e454-4bc5-abe2-ab3a70bf08de" returned: 0 in 0.817s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-42e59c04-e454-4bc5-abe2-ab3a70bf08de {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:22 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-42e59c04-e454-4bc5-abe2-ab3a70bf08de Jun 02 16:31:22 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:22 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 -F qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d" returned: 0 in 0.705s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:22 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d is being set with open permissions: ugo+rw Jun 02 16:31:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:22 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d Jun 02 16:31:22 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:22 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-42e59c04-e454-4bc5-abe2-ab3a70bf08de" returned: 0 in 0.638s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:22 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-quobyte-42e59c04-e454-4bc5-abe2-ab3a70bf08de" released by "delete_volume" :: held 1.504s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:22 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Created reservations ['0724c6c7-5a88-4739-a7a6-bc17d8fc3cec', 'fe6a52e0-303e-4f9d-be87-1f645467f077', '83032901-879d-4745-b7de-8fa4ebb04b14', '8964557f-91b2-4cdf-97f6-3bea5918d4e3'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:31:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:22 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:22 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:22 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:31:22 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:23 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d" returned: 0 in 0.633s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:23 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.info Jun 02 16:31:23 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "cinder-2228e598-6c99-4362-9a8a-f8cc8e05c62b-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-2228e598-6c99-4362-9a8a-f8cc8e05c62b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "cinder-quobyte-2228e598-6c99-4362-9a8a-f8cc8e05c62b" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-quobyte-2228e598-6c99-4362-9a8a-f8cc8e05c62b" acquired by "delete_volume" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:23 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.639s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:23 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:31:23 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[9153eb3d-a10d-47ef-bd58-4ffacb8d2b59]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2228e598-6c99-4362-9a8a-f8cc8e05c62b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:23 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Deleted volume successfully. Jun 02 16:31:23 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1626fbc5-2d86-4ef2-8f0c-ad4306a56581 tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-42e59c04-e454-4bc5-abe2-ab3a70bf08de-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:23 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2228e598-6c99-4362-9a8a-f8cc8e05c62b Jun 02 16:31:23 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:23 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.info" returned: 0 in 0.691s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:23 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.info is being set with open permissions: ugo+rw Jun 02 16:31:23 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.info {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:23 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.info Jun 02 16:31:23 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:24 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.info" returned: 0 in 0.578s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.330s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:24 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2228e598-6c99-4362-9a8a-f8cc8e05c62b" returned: 0 in 0.763s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2228e598-6c99-4362-9a8a-f8cc8e05c62b {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:24 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-cd4d838c-f907-428d-ab26-5c4defd9804b tempest-SnapshotDependencyTests-1712593002 None] Create snapshot completed successfully Jun 02 16:31:24 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2228e598-6c99-4362-9a8a-f8cc8e05c62b Jun 02 16:31:24 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:24 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:24 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-2228e598-6c99-4362-9a8a-f8cc8e05c62b" returned: 0 in 0.593s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:24 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-quobyte-2228e598-6c99-4362-9a8a-f8cc8e05c62b" released by "delete_volume" :: held 1.404s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Created reservations ['6f7906ab-5e94-426b-9b84-c9d24c33bb36', 'd21afec5-1ce4-426e-aabd-82af3bdc4dee', '15d592d5-be97-4814-aeaa-f707a5953912', '21f23649-2463-41fb-96b9-0d8a54892e86'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:25 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:31:25 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:25 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.658s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:31:25 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Deleted volume successfully. Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86488) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-437823ff-09e8-4054-9c9f-722fb5c4a01f tempest-CreateVolumesFromSourceVolumeTest-138558893 None] Lock "cinder-2228e598-6c99-4362-9a8a-f8cc8e05c62b-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Flow 'volume_create_manager' (ea9c5b1f-446a-4ec3-90cb-0b086a7f6618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538f2243-02f7-4946-8c0d-477bf49852ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538f2243-02f7-4946-8c0d-477bf49852ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T14:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28595536-0cd1-43b5-b6bf-d66d1e79b1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652a7e582c544231a353f80cb3f3a404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T14:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=70064d96-e6dd-43c5-b0c4-04cc0c63108d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T14:31:26Z,use_quota=True,user_id='4019a48e4bad483590665c084907a7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae6f5c0-8016-487b-9905-677c9b6c8479),volume_type_id=6ae6f5c0-8016-487b-9905-677c9b6c8479)' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c073b3-8c11-42f7-93ab-5b67f9b4bf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c073b3-8c11-42f7-93ab-5b67f9b4bf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d4edcb-a69e-40f7-ade2-beba69f81ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d4edcb-a69e-40f7-ade2-beba69f81ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '28595536-0cd1-43b5-b6bf-d66d1e79b1dc', 'volume_name': 'volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc', 'volume_size': 1, 'snapshot_id': '70064d96-e6dd-43c5-b0c4-04cc0c63108d'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d792b74-de32-4cba-8443-b4c74f72ba87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d792b74-de32-4cba-8443-b4c74f72ba87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2636d745-0b39-420f-ab76-b91785d35695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:25 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Volume 28595536-0cd1-43b5-b6bf-d66d1e79b1dc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc', 'volume_size': 1, 'snapshot_id': '70064d96-e6dd-43c5-b0c4-04cc0c63108d'} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Acquiring lock "cinder-quobyte-70064d96-e6dd-43c5-b0c4-04cc0c63108d-28595536-0cd1-43b5-b6bf-d66d1e79b1dc" by "_create_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-quobyte-70064d96-e6dd-43c5-b0c4-04cc0c63108d-28595536-0cd1-43b5-b6bf-d66d1e79b1dc" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Creating volume 28595536-0cd1-43b5-b6bf-d66d1e79b1dc from snapshot 70064d96-e6dd-43c5-b0c4-04cc0c63108d {{(pid=86488) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Selected osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757 as target Quobyte volume. {{(pid=86488) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Acquiring lock "cinder-quobyte-28595536-0cd1-43b5-b6bf-d66d1e79b1dc" by "_copy_volume_from_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-quobyte-28595536-0cd1-43b5-b6bf-d66d1e79b1dc" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] snapshot: 70064d96-e6dd-43c5-b0c4-04cc0c63108d, volume: 28595536-0cd1-43b5-b6bf-d66d1e79b1dc, {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5d40c1-ab2c-4799-a336-9c16ac127d64]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:25 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:26 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d Jun 02 16:31:26 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:26 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d" returned: 0 in 0.771s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:26 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:31:26 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 16:31:26 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Creating direct copy from snapshot {{(pid=86488) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 16:31:26 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb1e86c-3194-4e05-8630-940d07b00894]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:26 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:26 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 Jun 02 16:31:26 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:27 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622" returned: 0 in 0.811s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:27 devstack cinder-volume[86488]: DEBUG cinder.utils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Path /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc not found in is_blk_device check {{(pid=86488) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 16:31:27 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:27 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc Jun 02 16:31:27 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:31 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:31 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc" returned: 0 in 4.416s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:32 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[01da12b2-67d5-467c-b9e6-9cd9b921fad4]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:32 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 Jun 02 16:31:32 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:32 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622" returned: 0 in 0.844s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:32 devstack cinder-volume[86488]: DEBUG cinder.image.image_utils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Image conversion details: src /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622, size 1024.00 MB, duration 4.42 sec, destination /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc {{(pid=86488) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 16:31:32 devstack cinder-volume[86488]: INFO cinder.image.image_utils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Converted 1024.00 MB image at 231.82 MB/s Jun 02 16:31:32 devstack cinder-volume[86488]: WARNING cinder.volume.drivers.remotefs [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc is being set with open permissions: ugo+rw Jun 02 16:31:32 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:32 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc Jun 02 16:31:32 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:33 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc" returned: 0 in 0.620s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-quobyte-28595536-0cd1-43b5-b6bf-d66d1e79b1dc" released by "_copy_volume_from_snapshot" :: held 7.564s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:33 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-quobyte-70064d96-e6dd-43c5-b0c4-04cc0c63108d-28595536-0cd1-43b5-b6bf-d66d1e79b1dc" released by "_create_volume_from_snapshot" :: held 7.594s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:33 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.609s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2636d745-0b39-420f-ab76-b91785d35695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc', 'volume_size': 1, 'snapshot_id': '70064d96-e6dd-43c5-b0c4-04cc0c63108d'}' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9644d411-a3a3-4bd8-ae1b-b80db9380044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 16:31:33 devstack cinder-volume[86488]: INFO cinder.volume.flows.manager.create_volume [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Volume volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc (28595536-0cd1-43b5-b6bf-d66d1e79b1dc): created successfully Jun 02 16:31:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9644d411-a3a3-4bd8-ae1b-b80db9380044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86488) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 16:31:33 devstack cinder-volume[86488]: DEBUG cinder.volume.manager [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Flow 'volume_create_manager' (ea9c5b1f-446a-4ec3-90cb-0b086a7f6618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86488) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 16:31:33 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-72a5fa1f-0d4b-4fbe-ab62-f7a6e5e2db6d tempest-SnapshotDependencyTests-1712593002 None] Created volume successfully. Jun 02 16:31:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] Acquiring lock "cinder-70064d96-e6dd-43c5-b0c4-04cc0c63108d-delete_snapshot" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-70064d96-e6dd-43c5-b0c4-04cc0c63108d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] Acquiring lock "cinder-quobyte-8398fcaf-8282-4e4c-b14d-2778e5c7d622" by "delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-quobyte-8398fcaf-8282-4e4c-b14d-2778e5c7d622" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] Acquiring lock "cinder-quobyte-70064d96-e6dd-43c5-b0c4-04cc0c63108d" by "_delete_snapshot" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:34 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-quobyte-70064d96-e6dd-43c5-b0c4-04cc0c63108d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] Deleting offline snapshot 70064d96-e6dd-43c5-b0c4-04cc0c63108d of volume 8398fcaf-8282-4e4c-b14d-2778e5c7d622 {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 16:31:34 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] snapshot_file for this snap is: volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d {{(pid=86488) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 16:31:34 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2495b0-1a18-4d2f-a79f-a097fb03fd89]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:34 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:34 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d Jun 02 16:31:34 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:35 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d" returned: 0 in 0.767s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:35 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.remotefs [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86488) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 16:31:35 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d9b187-3c69-445f-9549-47e4257f09ed]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:35 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:35 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 Jun 02 16:31:35 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:36 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622" returned: 0 in 0.736s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:36 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d Jun 02 16:31:36 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:36 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d" returned: 0 in 0.737s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:36 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:36 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d Jun 02 16:31:36 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:37 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622.70064d96-e6dd-43c5-b0c4-04cc0c63108d" returned: 0 in 0.601s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-quobyte-70064d96-e6dd-43c5-b0c4-04cc0c63108d" released by "_delete_snapshot" :: held 2.949s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-quobyte-8398fcaf-8282-4e4c-b14d-2778e5c7d622" released by "delete_snapshot" :: held 2.971s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:37 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] Created reservations ['78c42ec2-5d53-4d5b-b212-00f05f30dc5e', '5049a105-33c8-4522-ae9e-dc436df5eeb6', '98f037b1-d78b-4f6b-bbbb-02b585eb2d02', 'e4ffbb14-0a34-4b4f-85d9-d1f1b33b459f'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:31:37 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] Delete snapshot completed successfully. Jun 02 16:31:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-1fec9d98-69f5-4350-8f3d-4a10a1178a63 tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-70064d96-e6dd-43c5-b0c4-04cc0c63108d-delete_snapshot" released by "delete_snapshot" :: held 3.114s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] Acquiring lock "cinder-8398fcaf-8282-4e4c-b14d-2778e5c7d622-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-8398fcaf-8282-4e4c-b14d-2778e5c7d622-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] Acquiring lock "cinder-quobyte-8398fcaf-8282-4e4c-b14d-2778e5c7d622" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:37 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-quobyte-8398fcaf-8282-4e4c-b14d-2778e5c7d622" acquired by "delete_volume" :: waited 0.015s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:37 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3cacc0-c443-4e64-9986-61e05023d82e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:37 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:37 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 Jun 02 16:31:37 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:38 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622" returned: 0 in 0.718s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:38 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:38 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622 Jun 02 16:31:38 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:39 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-8398fcaf-8282-4e4c-b14d-2778e5c7d622" returned: 0 in 0.602s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-quobyte-8398fcaf-8282-4e4c-b14d-2778e5c7d622" released by "delete_volume" :: held 1.382s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] Created reservations ['60bd8aad-5104-4ae8-8fd1-d60da8b07ca0', '9a9f6381-47ab-42d8-a312-079600050190', '4c9ec06a-f161-4f76-8640-6b6932e4652b', 'a7c70571-f72f-4405-8b90-e2af083b428b'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:39 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:31:39 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:39 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.571s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:31:39 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] Deleted volume successfully. Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-907592df-8403-4af7-89de-cf7aac72525e tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-8398fcaf-8282-4e4c-b14d-2778e5c7d622-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] Acquiring lock "cinder-28595536-0cd1-43b5-b6bf-d66d1e79b1dc-delete_volume" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-28595536-0cd1-43b5-b6bf-d66d1e79b1dc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] Acquiring lock "cinder-quobyte-28595536-0cd1-43b5-b6bf-d66d1e79b1dc" by "delete_volume" {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-quobyte-28595536-0cd1-43b5-b6bf-d66d1e79b1dc" acquired by "delete_volume" :: waited 0.014s {{(pid=86488) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG oslo.privsep.daemon [-] privsep: reply[74932a3c-eacb-4e5d-ae01-68bd43ad8b9e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 16:31:39 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:40 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc Jun 02 16:31:40 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:40 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc" returned: 0 in 0.695s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:40 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:40 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc Jun 02 16:31:40 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:41 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d/volume-28595536-0cd1-43b5-b6bf-d66d1e79b1dc" returned: 0 in 0.596s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:41 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-quobyte-28595536-0cd1-43b5-b6bf-d66d1e79b1dc" released by "delete_volume" :: held 1.337s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:41 devstack cinder-volume[86488]: DEBUG cinder.quota [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] Created reservations ['98b0e910-ff09-497e-afa2-fbf3a14936a1', '6cf56fb8-f91a-4c84-bf2b-cac5c93b3a54', 'a1fdda85-9b8f-4168-8142-b5128e96f6b7', 'd250934f-69bf-4761-b79c-755ec3d973d1'] {{(pid=86488) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 16:31:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:31:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:31:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:31:41 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:31:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:31:41 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:31:41 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:31:41 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:31:41 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Jun 02 16:31:42 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.616s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:31:42 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 16:31:42 devstack cinder-volume[86488]: INFO cinder.volume.manager [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] Deleted volume successfully. Jun 02 16:31:42 devstack cinder-volume[86488]: DEBUG cinder.coordination [None req-a7f5decb-04b6-4171-a094-d5c6006e47a9 tempest-SnapshotDependencyTests-1712593002 None] Lock "cinder-28595536-0cd1-43b5-b6bf-d66d1e79b1dc-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=86488) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 16:31:51 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=77,cinder:UPDATE=115,cinder:DELETE=13,cinder:INSERT=24 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:31:52 devstack cinder-volume[86488]: DEBUG dbcounter [-] [86488] Writing DB stats cinder:SELECT=83,cinder:UPDATE=113,cinder:INSERT=32,cinder:DELETE=7 {{(pid=86488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 16:32:00 devstack cinder-volume[86488]: DEBUG oslo_service.periodic_task [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 16:32:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 16:32:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 16:32:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757': None} {{(pid=86488) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 16:32:00 devstack cinder-volume[86488]: DEBUG cinder.volume.drivers.quobyte [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29533a4a-e23d-4137-9f30-2c2c2dbc2757'] {{(pid=86488) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 16:32:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.lockutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86488) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 16:32:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 16:32:00 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d Jun 02 16:32:00 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 16:32:00 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jun 02 16:32:00 devstack cinder-volume[86488]: DEBUG oslo_concurrency.processutils [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2e83fd92139cedc9f057d9966f54b74d" returned: 0 in 0.568s {{(pid=86488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 16:32:00 devstack cinder-volume[86488]: DEBUG cinder.manager [None req-8513845a-fda5-4445-9112-dfdadedeacfb None None] Notifying Schedulers of capabilities ... {{(pid=86488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}